-- Logs begin at Mon 2022-09-12 23:12:54 UTC, end at Tue 2022-09-13 00:15:08 UTC. -- Sep 12 23:44:13.518533 dv-cinder-820027-26-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 12 23:44:13.527481 dv-cinder-820027-26-iscsi devstack@n-api.service[111968]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 12 23:44:13.529478 dv-cinder-820027-26-iscsi devstack@n-api.service[111968]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 12 23:44:13 2022] *** Sep 12 23:44:13.529478 dv-cinder-820027-26-iscsi devstack@n-api.service[111968]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 12 23:44:13.529478 dv-cinder-820027-26-iscsi devstack@n-api.service[111968]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 12 23:44:13.529478 dv-cinder-820027-26-iscsi devstack@n-api.service[111968]: nodename: dv-cinder-820027-26-iscsi Sep 12 23:44:13.529478 dv-cinder-820027-26-iscsi devstack@n-api.service[111968]: machine: x86_64 Sep 12 23:44:13.529478 dv-cinder-820027-26-iscsi devstack@n-api.service[111968]: clock source: unix Sep 12 23:44:13.529478 dv-cinder-820027-26-iscsi devstack@n-api.service[111968]: pcre jit disabled Sep 12 23:44:13.529478 dv-cinder-820027-26-iscsi devstack@n-api.service[111968]: detected number of CPU cores: 4 Sep 12 23:44:13.529478 dv-cinder-820027-26-iscsi devstack@n-api.service[111968]: current working directory: / Sep 12 23:44:13.529478 dv-cinder-820027-26-iscsi devstack@n-api.service[111968]: detected binary path: /usr/bin/uwsgi-core Sep 12 23:44:13.529478 dv-cinder-820027-26-iscsi devstack@n-api.service[111968]: your processes number limit is 47680 Sep 12 23:44:13.529478 dv-cinder-820027-26-iscsi devstack@n-api.service[111968]: your memory page size is 4096 bytes Sep 12 23:44:13.530270 dv-cinder-820027-26-iscsi devstack@n-api.service[111968]: detected max file descriptor number: 2048 Sep 12 23:44:13.530270 dv-cinder-820027-26-iscsi devstack@n-api.service[111968]: lock engine: pthread robust mutexes Sep 12 23:44:13.530270 dv-cinder-820027-26-iscsi devstack@n-api.service[111968]: thunder lock: enabled Sep 12 23:44:13.530270 dv-cinder-820027-26-iscsi devstack@n-api.service[111968]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 12 23:44:13.530270 dv-cinder-820027-26-iscsi devstack@n-api.service[111968]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 12 23:44:13.568571 dv-cinder-820027-26-iscsi devstack@n-api.service[111968]: Python main interpreter initialized at 0x55ff452fd9c0 Sep 12 23:44:13.568571 dv-cinder-820027-26-iscsi devstack@n-api.service[111968]: python threads support enabled Sep 12 23:44:13.568571 dv-cinder-820027-26-iscsi devstack@n-api.service[111968]: your server socket listen backlog is limited to 100 connections Sep 12 23:44:13.568571 dv-cinder-820027-26-iscsi devstack@n-api.service[111968]: your mercy for graceful operations on workers is 90 seconds Sep 12 23:44:13.568924 dv-cinder-820027-26-iscsi devstack@n-api.service[111968]: mapped 403077 bytes (393 KB) for 2 cores Sep 12 23:44:13.568998 dv-cinder-820027-26-iscsi devstack@n-api.service[111968]: *** Operational MODE: preforking *** Sep 12 23:44:13.569239 dv-cinder-820027-26-iscsi devstack@n-api.service[111968]: *** uWSGI is running in multiple interpreter mode *** Sep 12 23:44:13.569239 dv-cinder-820027-26-iscsi devstack@n-api.service[111968]: spawned uWSGI master process (pid: 111968) Sep 12 23:44:13.569393 dv-cinder-820027-26-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 12 23:44:13.571679 dv-cinder-820027-26-iscsi devstack@n-api.service[111968]: spawned uWSGI worker 1 (pid: 111969, cores: 1) Sep 12 23:44:13.571679 dv-cinder-820027-26-iscsi devstack@n-api.service[111968]: spawned uWSGI worker 2 (pid: 111970, cores: 1) Sep 12 23:44:13.571679 dv-cinder-820027-26-iscsi devstack@n-api.service[111968]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 12 23:44:14.228729 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 12 23:44:14.236459 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 12 23:44:15.314656 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 12 23:44:15.314656 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: from cryptography.utils import int_from_bytes Sep 12 23:44:15.315443 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 12 23:44:15.315443 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: from cryptography.utils import int_from_bytes Sep 12 23:44:15.315443 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 12 23:44:15.315443 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: from cryptography.utils import int_from_bytes Sep 12 23:44:15.315906 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 12 23:44:15.315906 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: from cryptography.utils import int_from_bytes Sep 12 23:44:17.774023 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 12 23:44:17.774691 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 12 23:44:17.774691 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 12 23:44:17.775114 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 12 23:44:17.775190 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 12 23:44:17.775298 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 12 23:44:17.775298 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 12 23:44:17.775438 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 12 23:44:17.775509 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 12 23:44:17.775573 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 12 23:44:17.775749 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.775842 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.776083 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.776221 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.776436 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.776540 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.776775 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.776923 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.777108 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.777263 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.777455 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.777595 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.777771 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.777859 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.778018 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.778158 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.778345 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.778444 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.778670 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.778836 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.778918 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.779000 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.779201 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-26-iscsi {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.779332 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-26-iscsi {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.779573 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.779729 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.779851 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.779967 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.780168 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.780349 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.780474 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.781396 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.781396 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.781396 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.781636 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.781727 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.781804 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.782069 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.782236 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.782358 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.782561 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.782867 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.783056 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.783179 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.783339 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.783508 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.783654 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.783787 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.783888 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.784128 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.784255 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.784395 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.784493 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.784739 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.784878 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.785030 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.785185 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.785318 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.785436 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-26-iscsi {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.785642 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.785736 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.785952 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.786043 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.786354 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.786441 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-26-iscsi {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.786668 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.786756 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.786976 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.787065 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.787309 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.787462 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.787685 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.787776 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.788006 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.788101 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.788310 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.788402 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.788626 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.788720 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.788941 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.789076 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.789247 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.789344 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.789567 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.789659 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.789868 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.789966 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.790174 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.790268 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.790479 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.790575 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.790774 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.790868 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.791083 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.791570 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.791774 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.792004 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.792099 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.792185 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.792403 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.792498 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.792705 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.792803 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.792956 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.793103 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.793261 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.793406 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.793565 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.793660 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.793886 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.793976 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.794203 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.794287 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.794453 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.794549 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.794703 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.794817 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.795022 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.795107 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.795360 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.795466 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.795672 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.795757 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.795984 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.796067 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.796291 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.796384 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.796596 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.796685 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.796901 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.796992 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.797205 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.797294 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.797508 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.797593 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.797813 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.797903 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.798117 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.798201 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.798430 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.798518 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.798750 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.798842 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.799056 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.799140 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.799398 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.799493 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.799747 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.799840 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.800027 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.800108 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.800332 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.800423 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.800664 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.800755 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.800979 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.801069 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.801281 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.801364 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.801586 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.801678 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.801891 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.801975 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.802192 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.802274 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.802495 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.802588 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.802798 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.802888 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.803049 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.803140 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.803373 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.803479 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.803677 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.803764 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.803977 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.804060 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.804275 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.804361 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.804575 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.804659 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.804876 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.804972 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.805173 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.805258 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.805473 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.805562 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.805772 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.805854 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.806071 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.806154 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.806372 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.806455 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.806671 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.806759 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.806970 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.807059 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.807291 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.807389 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.807649 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.807745 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.807951 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.808035 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.808255 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.808350 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.808558 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.808650 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.808859 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.808942 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.809159 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.809241 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.809461 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.809558 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.809761 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.809857 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.810062 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.810145 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.810361 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.810461 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.810663 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.810747 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.810961 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.811090 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.811301 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.811461 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.811606 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.811691 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.811907 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.811990 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.812220 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.812312 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.812521 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.812611 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.812820 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.812902 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.813131 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.813222 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.813428 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.813513 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.813791 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.813882 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.814037 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.814131 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.814334 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.814416 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.814634 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.814725 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.814935 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.815026 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.815257 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.815407 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.815559 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.815646 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.815862 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.815946 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.816162 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.816245 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.816460 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.816549 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.816758 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.816851 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.817060 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.817143 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.817361 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.817445 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.817658 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.817743 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.817960 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.818048 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.818266 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.818360 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.818567 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.818657 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.818870 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.818953 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.819173 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.819283 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.819514 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:44:17.819597 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.819848 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.819932 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.820178 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.820270 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.820507 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.820591 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.820819 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.820908 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.821130 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.821224 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.821443 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.821529 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.821764 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.821845 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.822076 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.822160 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.822391 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.822482 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.822700 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.822782 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.823010 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.823093 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.823367 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.823468 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.823681 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.823774 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.824001 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.824087 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.824316 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.824399 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.824634 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.824719 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.824947 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.825042 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.825259 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.825354 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.825575 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.825665 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.825890 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.825974 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.826201 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.826293 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.826526 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.826609 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.826845 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.826930 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.827155 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.827288 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.827512 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.827604 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.827832 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.827924 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.828151 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.828242 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.828480 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.828578 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.828773 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.828865 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.829084 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.829174 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.829396 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.829488 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.829706 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.829790 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.830023 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.830115 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.830335 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.830432 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.830641 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.830730 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.830955 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.831045 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.831282 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.831370 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.831603 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.831688 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.831914 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.831997 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.832226 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.832311 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.832537 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.832621 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.832848 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.832932 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.833160 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.833245 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.833474 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.833563 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.833784 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.833868 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.834100 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.834184 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.834409 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.834501 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.834716 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.834799 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.835020 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.835104 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.835349 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.835436 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.835656 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.835756 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.835958 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.836054 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.836260 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.836342 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.836561 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.836653 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.836861 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.836951 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.837169 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.837252 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.837473 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.837564 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.837791 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.837874 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.838092 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.838175 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.838406 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.838499 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.838729 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.838844 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.839073 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.839164 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.839403 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.839489 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.839713 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.839797 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.840020 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.840102 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.840320 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.840404 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.840632 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.840716 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.840937 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.841019 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.841237 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.841372 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.841561 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.841746 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.841842 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.841921 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.842150 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.842245 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.842464 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.842548 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.842764 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.842856 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.843069 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.843160 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.843406 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.843501 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.843713 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.843808 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.844022 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.844104 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.844330 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.844421 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.844636 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.844732 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.844957 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.845044 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.845267 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.845358 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.845571 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.845666 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.845893 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.845985 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.846215 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.846305 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.846518 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.846602 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.846821 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.846910 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.847128 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.847212 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.847458 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.847545 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.847762 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.847846 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.848067 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.848151 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.848370 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.848453 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.848671 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.848753 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.848976 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.849064 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.849276 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.849369 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.849585 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.849679 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.849873 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.849969 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.850174 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.850265 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.850481 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.850565 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.850783 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.850875 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.851084 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.851167 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.851412 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.851499 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.851716 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.851807 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.852019 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.852104 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.852320 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.852404 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.852662 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.852763 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.852969 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.853052 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.853295 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.853390 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.853606 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.853693 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.853920 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.854002 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.854227 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.854311 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.854787 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.854913 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.855006 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.855277 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.855414 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.855563 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.855666 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.855875 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.855959 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.856192 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.856284 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.856503 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.856597 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.856824 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.856915 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.857132 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.857224 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.857450 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.857543 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.857753 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.857883 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.858068 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.858152 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.858384 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.858492 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.858698 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.858783 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.859003 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.859094 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.859348 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.859436 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.859670 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.859792 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.859987 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.860084 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.860295 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.860381 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.860602 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.860687 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.860910 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.860993 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.861215 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.861300 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.861521 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.861619 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.861828 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.861924 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.862134 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.862225 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.862437 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.862520 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.862752 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.862843 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.863056 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.863146 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.863389 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.863474 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.863689 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.863789 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.864001 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.864085 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.864305 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.864395 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.864623 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.864718 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.864926 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.865018 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.865232 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.865322 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.865549 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.865634 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.865857 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.865987 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.866166 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.866251 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.866473 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.866559 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.866777 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.866860 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.867080 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.867164 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.867412 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.867498 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.867820 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.868088 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.868088 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.868344 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.868479 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.868602 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.868684 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.868767 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.868906 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.868999 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.869208 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.869290 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.869508 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.869601 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.869809 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.869912 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.870176 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.870305 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.870498 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.870610 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.870808 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.870932 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.871121 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.871289 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.871460 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.871579 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.871760 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.871890 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.872060 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.872170 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.872380 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.872490 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.872689 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.872800 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.872992 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.873102 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.873292 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.873454 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.873595 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.873934 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.874017 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.874244 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.874432 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.874546 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.874860 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.874944 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.875179 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.875396 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.875532 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.875847 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.875947 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.876158 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.876379 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.876471 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.876781 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.876949 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.877088 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.877343 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.877430 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.877677 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.877973 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.878073 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.878288 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.878555 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.878679 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.878907 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.879057 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.879284 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.879417 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.879551 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.879746 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.879926 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.880070 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.880169 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.880401 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.880484 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.880725 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.880809 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.881043 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.881349 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.881435 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.881689 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.881962 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.882054 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.882319 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.882596 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.882680 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.882930 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.883027 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.883286 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.883373 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.883609 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.883702 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.883929 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.884020 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.884237 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.884327 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.884547 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.884630 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.884849 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.884932 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.885153 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.885244 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.885465 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.885771 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.885865 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.886090 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.886174 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.886395 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.886486 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.886705 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.886789 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.887007 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.887090 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.887337 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.887437 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.887644 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.887729 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.887952 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.888042 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.888274 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.888364 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.888578 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.888663 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.888891 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.888985 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.889195 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.889292 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.889512 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.889595 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.889818 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.889908 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.890123 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.890244 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.890422 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.890526 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.890724 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.890816 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.891033 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.891127 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.891362 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.891450 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.891672 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.891759 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.891979 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.892279 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.892365 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.892595 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.892900 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.892984 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.893217 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.893453 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.893549 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.893833 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.893916 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.894145 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.894237 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.894450 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.894540 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.894755 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.894846 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.895059 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.895152 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.895423 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.895508 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.895732 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.895814 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.896075 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.896207 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.896411 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.896725 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.896810 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.897047 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.897139 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.897354 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.897438 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.897667 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.897750 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.897973 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.898066 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.898278 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.898407 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.898584 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.898675 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.898896 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.898989 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.899203 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.899339 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.899531 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.899617 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.899857 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.900003 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.900158 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.900471 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.900569 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.900784 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.901087 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.901179 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.901470 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.901730 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.901847 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.902091 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.902331 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.902431 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.902701 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.903031 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.903369 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.903471 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.903682 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.903767 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.903994 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.904079 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.904306 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.904398 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.904615 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.904699 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.904944 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.905116 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.905233 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.905519 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.905604 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.905850 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.906083 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.906176 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.906447 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.906575 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.906767 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.907079 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.907163 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.907406 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.907706 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.907805 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.908034 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.908186 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.908502 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.908584 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.908818 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.909049 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.909134 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.909451 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.909560 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.909757 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.910052 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.910140 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.910364 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.910541 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.910668 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.910976 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.911138 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.911314 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.911562 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.911647 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.911916 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.912065 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.912221 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.912526 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.912651 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.912835 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.912965 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.913154 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.913269 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.913465 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.913579 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.913770 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.913890 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.914075 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.914198 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.914378 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.914512 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.914820 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.914951 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.915072 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.915182 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.915398 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.915514 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.915706 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.915823 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.916019 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.916541 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.916707 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.917050 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.917137 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.917368 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.917505 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.917681 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.917796 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.917988 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.918109 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.918310 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.918428 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.918627 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.918750 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.918940 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.919093 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.919266 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.919432 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.919573 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.919756 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.919897 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.920079 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.920209 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.920519 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.920615 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.920840 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.921034 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.921152 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.921390 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.921504 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.921706 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.921820 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.922030 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.922152 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.922351 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.922482 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.922649 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.922759 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.922956 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.923082 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.923292 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.923410 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.923608 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.923753 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.923922 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.924018 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.924233 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.924464 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.924549 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.924841 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.924972 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.925152 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.925312 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.925463 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.925644 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.925772 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.925957 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.926074 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.926272 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.926398 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.926588 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.926718 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.926905 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.926991 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.927239 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.927325 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.927589 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.927674 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.927911 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.928140 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.928224 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.928648 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.928731 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.928959 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.929185 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.929260 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.929508 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.929583 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.929828 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.929910 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.930146 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.930221 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.930528 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.930623 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.930771 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.930863 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.931072 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.931154 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.931433 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.931518 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.931749 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.931843 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.932057 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.932141 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.932370 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.932478 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.932734 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.932828 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.933043 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.933127 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.933350 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.933433 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.933672 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.933791 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.933977 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.934106 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.934281 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.934424 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.934586 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.934735 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.934910 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.935047 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.935235 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.935386 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.935561 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.935705 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.935978 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.936063 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.936294 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.936380 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.936600 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.936726 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.937014 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.937107 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.937328 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.937420 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.937640 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.937724 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.937947 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.938037 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.938253 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.938355 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.938563 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.938656 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.938880 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.938971 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.939183 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.939360 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.939496 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.939579 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.939805 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.939891 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.940131 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.940241 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.940440 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.940534 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.940758 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.940846 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.941065 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.941172 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.941387 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.941486 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.941710 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.941802 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.942023 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.942179 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.942344 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.942493 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.942760 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.942852 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.943083 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.943168 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.943422 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.943529 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.943747 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.943832 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.944051 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.944142 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.944369 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.944461 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.944670 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.944755 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.944983 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.945068 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.945295 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.945392 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.945603 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.945707 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.945912 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.946005 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.946215 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.946299 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.946525 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.946617 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.946835 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.946929 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.947145 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.947247 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.947496 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.947647 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.947782 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.947924 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.948547 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.949206 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.949476 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.949851 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.949987 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.950120 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.950250 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.950384 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.950511 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.950636 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.950725 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.950800 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.950880 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.950954 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.951052 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.951131 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.951205 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.951376 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.951512 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.951646 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.951778 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.951907 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.952031 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.952160 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.952283 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.952375 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.952443 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.952507 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.952622 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.952697 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.952761 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.952830 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.953003 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.953099 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.953314 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.953399 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.953633 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.953715 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.953949 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.954041 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.954266 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.954350 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.954581 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.954683 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.954882 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.954978 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.955204 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.955400 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.955530 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.955613 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.955828 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.955929 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.956133 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.956218 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.956434 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.956518 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.956741 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.956827 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.957045 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.957132 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.957353 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.957437 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.957655 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.957741 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.957959 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.958043 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.958268 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.958353 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.958591 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.958684 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.958895 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.958992 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.959238 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.959337 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.959546 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.959671 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.959850 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.959934 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.960155 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.960248 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.960458 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.960544 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.960758 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.960841 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.961069 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.961161 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.961374 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.961494 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.961680 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.961774 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.961985 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.962081 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.962292 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.962376 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.968166 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.968355 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.968433 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.968516 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.968597 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.968675 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.968753 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.968831 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.968918 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.969005 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.969090 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.969157 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.969221 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.969283 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.969355 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.969421 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.969497 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.969573 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.969650 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.969726 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.969801 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.969801 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.969925 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.970003 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.970086 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.970164 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.970322 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.970403 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.970480 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.970557 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.970632 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.970632 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.970783 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.970860 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.970936 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.971001 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.971064 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.971136 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.971202 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.971349 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.971435 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.971525 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.971613 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.971613 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.971764 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.971841 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.971916 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.972001 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.972090 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.972176 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.972254 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.972254 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.972400 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.972477 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.972561 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.972645 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.972730 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.972808 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.972873 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.972946 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.973024 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.973090 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.973154 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.973224 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.973290 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.973365 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.973456 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.973534 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.973610 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.973694 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.973772 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.973860 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.973940 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.974005 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.974136 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.974251 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.974457 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.974550 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.974783 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.974868 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.975121 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.975207 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.975464 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.975552 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.975780 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.975865 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.976096 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.976181 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.976410 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.976496 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.976734 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.976818 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.977049 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.977142 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.977366 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.977451 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.977678 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.977763 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.977995 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.978251 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.978337 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.978571 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.978656 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.978905 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.978990 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.979238 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.979438 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.979623 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.979709 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.979937 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.980036 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.980249 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.980335 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.980563 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.980648 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.980869 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.980960 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.981174 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.981260 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.981485 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.981570 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.981796 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.981895 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.982098 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.982184 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.982415 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.982498 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.982722 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.982815 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.983027 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.983302 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.983429 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.983623 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.983718 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.983956 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.984208 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.984301 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.984565 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.984650 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.984885 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.984971 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.985203 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.985286 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.985528 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.985620 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.985832 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.985917 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.986134 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.986219 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.986445 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.986531 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.986751 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.986836 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.987050 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.987141 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.987390 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.987491 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.987699 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.987783 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.988003 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.988086 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.988309 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.988403 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.988615 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.988706 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.988922 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.989158 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.989244 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.989509 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.989595 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.989814 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.989910 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.990139 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.990222 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.990445 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.990531 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.990752 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.990874 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.991056 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.991152 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.991404 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.991503 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.991710 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.991795 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.992014 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.992107 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.992316 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.992400 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.992620 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.992704 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.992922 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.993013 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.993226 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.993310 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.993533 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.993617 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.993836 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.993928 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.994137 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.994219 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.994447 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.994539 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.994749 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.994834 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.995112 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.995199 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.995443 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.995528 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.995752 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.995846 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.996053 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.996137 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.996363 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.996445 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.996672 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.996747 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.996973 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.997057 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.997278 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.997369 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.997582 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.997674 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.997895 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.997970 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.998199 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.998285 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.998508 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.998810 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.998893 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.999121 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.999205 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.999499 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.999576 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.999813 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:17.999897 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.000122 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.000207 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.000442 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.000525 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.000748 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.000838 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.001049 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.001322 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.001525 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.001711 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.001847 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.002069 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.002154 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.002397 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.002482 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.002710 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.002793 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.003021 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.003104 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.003356 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.003483 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.003669 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.003812 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.003979 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.004292 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.004395 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.004602 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.004717 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.004911 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.005048 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.005221 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.005396 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.005529 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.005733 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.005844 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.006047 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.006159 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.006362 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.006503 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.006674 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.006825 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.007005 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.007155 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.007345 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.007501 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.007665 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.007817 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.007980 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.008134 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.008293 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.008444 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.008610 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.008754 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.008925 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.009063 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.009237 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.009377 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.009553 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.009706 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.009866 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.010018 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.010177 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.010321 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.010489 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.010848 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.011112 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.011198 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.011456 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.011578 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.011780 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.011885 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.012100 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.012185 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.012411 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.012494 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.012735 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.012835 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.013052 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.013136 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.013362 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.013480 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.013670 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.013762 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.013982 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.014066 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.014292 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.014384 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.014602 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.014686 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.014917 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.015000 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.015281 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.015370 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.015578 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.015663 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.015881 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.015979 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.016184 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.016494 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.016587 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.016812 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.016896 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.017121 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.017205 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.017422 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.017507 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.017724 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.017809 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.018041 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.018133 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.018343 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.018428 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.018644 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.018732 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.018945 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.019031 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.019267 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.019369 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.019580 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.019694 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.019880 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.020020 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.020182 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.020354 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.020483 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.020679 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.020784 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.020985 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.021071 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.021290 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.021382 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.021600 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.021721 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.021911 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.022003 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.022229 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.022315 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.022534 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.022628 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.022835 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.022919 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.023133 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.023260 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.023465 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.023559 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.023767 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.023852 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.024119 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.024220 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.024374 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.024467 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.024675 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.024759 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.024981 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.025065 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.025283 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.025450 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.025585 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.025669 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.025885 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.025971 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.026188 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.026317 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.026487 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.026571 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.026787 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.026872 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.027092 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.027177 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.027418 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.027506 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.027721 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.027812 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.028021 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.028116 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.028324 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.028408 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.028623 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.028707 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.028952 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.029045 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.029283 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.029368 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.029592 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.029675 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.029907 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.029991 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.030215 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.030299 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.030534 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.030627 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.030839 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.030922 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.031150 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.031263 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.031497 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.031594 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.031804 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.031887 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.032110 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.032194 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.032419 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.032511 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.032730 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.032821 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.033039 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.033131 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.033350 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.033479 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.033662 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.033748 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.033970 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.034088 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.034278 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.034362 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.034593 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.034676 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.034915 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.034999 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.035265 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.035353 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.035559 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.035643 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.035883 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.035984 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.036204 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.036289 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.036520 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.036604 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.036832 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.036925 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.037162 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.037246 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.037472 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.037557 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.037783 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.037876 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.038094 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.038178 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.038397 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.038488 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.038642 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 12 23:44:18.038748 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.039006 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.039346 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.039665 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.040024 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.040356 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.040681 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.041042 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.041728 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.042116 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.042441 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.045016 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.045016 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.045016 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.045016 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.045016 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.045016 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.045016 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:44:18.045016 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=111969) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 12 23:44:18.196894 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: INFO dbcounter [None req-aa3f93fe-9984-4fbf-8a0f-794750de2298 None None] Registered counter for database nova_api Sep 12 23:44:18.201726 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: INFO dbcounter [None req-9a35851a-a3bf-43e6-ab0f-3dae42867094 None None] Registered counter for database nova_api Sep 12 23:44:18.220566 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG oslo_db.sqlalchemy.engines [None req-aa3f93fe-9984-4fbf-8a0f-794750de2298 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111970) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 23:44:18.222172 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG oslo_db.sqlalchemy.engines [None req-9a35851a-a3bf-43e6-ab0f-3dae42867094 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111969) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 23:44:18.227483 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG dbcounter [-] [111970] Writer thread running {{(pid=111970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 23:44:18.229002 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG dbcounter [-] [111969] Writer thread running {{(pid=111969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 23:44:18.285737 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.context [None req-9a35851a-a3bf-43e6-ab0f-3dae42867094 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f9381776-92ff-451b-9afd-34bdc816952e(cell1) {{(pid=111969) load_cells /opt/stack/nova/nova/context.py:464}} Sep 12 23:44:18.289607 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG oslo_concurrency.lockutils [None req-9a35851a-a3bf-43e6-ab0f-3dae42867094 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:44:18.290086 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG oslo_concurrency.lockutils [None req-9a35851a-a3bf-43e6-ab0f-3dae42867094 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:44:18.290845 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.context [None req-aa3f93fe-9984-4fbf-8a0f-794750de2298 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f9381776-92ff-451b-9afd-34bdc816952e(cell1) {{(pid=111970) load_cells /opt/stack/nova/nova/context.py:464}} Sep 12 23:44:18.292102 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG oslo_concurrency.lockutils [None req-9a35851a-a3bf-43e6-ab0f-3dae42867094 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:44:18.292827 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG oslo_concurrency.lockutils [None req-9a35851a-a3bf-43e6-ab0f-3dae42867094 None None] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:44:18.293262 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG oslo_concurrency.lockutils [None req-9a35851a-a3bf-43e6-ab0f-3dae42867094 None None] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:44:18.295183 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG oslo_concurrency.lockutils [None req-aa3f93fe-9984-4fbf-8a0f-794750de2298 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:44:18.295345 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG oslo_concurrency.lockutils [None req-9a35851a-a3bf-43e6-ab0f-3dae42867094 None None] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111969) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:44:18.295665 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG oslo_concurrency.lockutils [None req-aa3f93fe-9984-4fbf-8a0f-794750de2298 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:44:18.297234 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG oslo_concurrency.lockutils [None req-aa3f93fe-9984-4fbf-8a0f-794750de2298 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:44:18.297423 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: INFO dbcounter [None req-9a35851a-a3bf-43e6-ab0f-3dae42867094 None None] Registered counter for database nova_cell0 Sep 12 23:44:18.297961 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG oslo_concurrency.lockutils [None req-aa3f93fe-9984-4fbf-8a0f-794750de2298 None None] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:44:18.298406 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG oslo_concurrency.lockutils [None req-aa3f93fe-9984-4fbf-8a0f-794750de2298 None None] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:44:18.300523 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG oslo_concurrency.lockutils [None req-aa3f93fe-9984-4fbf-8a0f-794750de2298 None None] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=111970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:44:18.301312 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: INFO dbcounter [None req-9a35851a-a3bf-43e6-ab0f-3dae42867094 None None] Registered counter for database nova_cell1 Sep 12 23:44:18.302565 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: INFO dbcounter [None req-aa3f93fe-9984-4fbf-8a0f-794750de2298 None None] Registered counter for database nova_cell0 Sep 12 23:44:18.306777 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: INFO dbcounter [None req-aa3f93fe-9984-4fbf-8a0f-794750de2298 None None] Registered counter for database nova_cell1 Sep 12 23:44:18.308897 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG oslo_db.sqlalchemy.engines [None req-9a35851a-a3bf-43e6-ab0f-3dae42867094 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111969) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 23:44:18.310221 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG oslo_db.sqlalchemy.engines [None req-9a35851a-a3bf-43e6-ab0f-3dae42867094 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111969) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 23:44:18.314121 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG oslo_db.sqlalchemy.engines [None req-aa3f93fe-9984-4fbf-8a0f-794750de2298 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111970) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 23:44:18.316713 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG dbcounter [-] [111969] Writer thread running {{(pid=111969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 23:44:18.318492 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG dbcounter [-] [111969] Writer thread running {{(pid=111969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 23:44:18.319653 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG dbcounter [-] [111970] Writer thread running {{(pid=111970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 23:44:18.454334 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG oslo_db.sqlalchemy.engines [None req-aa3f93fe-9984-4fbf-8a0f-794750de2298 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111970) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 23:44:18.459094 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: INFO dbcounter [None req-9a35851a-a3bf-43e6-ab0f-3dae42867094 None None] Registered counter for database nova_cell0 Sep 12 23:44:18.460293 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG dbcounter [-] [111970] Writer thread running {{(pid=111970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 23:44:18.468194 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG oslo_db.sqlalchemy.engines [None req-9a35851a-a3bf-43e6-ab0f-3dae42867094 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111969) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 23:44:18.470410 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: INFO dbcounter [None req-aa3f93fe-9984-4fbf-8a0f-794750de2298 None None] Registered counter for database nova_cell0 Sep 12 23:44:18.473280 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG dbcounter [-] [111969] Writer thread running {{(pid=111969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 23:44:18.479625 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG oslo_db.sqlalchemy.engines [None req-aa3f93fe-9984-4fbf-8a0f-794750de2298 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=111970) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 23:44:18.484864 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG dbcounter [-] [111970] Writer thread running {{(pid=111970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 23:44:18.806342 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: WARNING keystonemiddleware.auth_token [None req-9a35851a-a3bf-43e6-ab0f-3dae42867094 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 12 23:44:18.810029 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: WARNING keystonemiddleware.auth_token [None req-aa3f93fe-9984-4fbf-8a0f-794750de2298 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 12 23:44:18.813679 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: WARNING keystonemiddleware.auth_token [None req-9a35851a-a3bf-43e6-ab0f-3dae42867094 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 12 23:44:18.817336 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: WARNING keystonemiddleware.auth_token [None req-aa3f93fe-9984-4fbf-8a0f-794750de2298 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 12 23:44:19.154410 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: WARNING keystonemiddleware.auth_token [None req-9a35851a-a3bf-43e6-ab0f-3dae42867094 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 12 23:44:19.157977 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: WARNING keystonemiddleware.auth_token [None req-aa3f93fe-9984-4fbf-8a0f-794750de2298 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 12 23:44:19.160450 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: WARNING keystonemiddleware.auth_token [None req-9a35851a-a3bf-43e6-ab0f-3dae42867094 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 12 23:44:19.163977 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: WARNING keystonemiddleware.auth_token [None req-aa3f93fe-9984-4fbf-8a0f-794750de2298 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 12 23:44:19.165880 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ff452fd9c0 pid: 111969 (default app) Sep 12 23:44:19.168398 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi [None req-9a35851a-a3bf-43e6-ab0f-3dae42867094 None None] Calling method '>' {{(pid=111969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:44:19.169594 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: INFO nova.api.openstack.requestlog [None req-9a35851a-a3bf-43e6-ab0f-3dae42867094 None None] 10.222.0.26 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001768 Sep 12 23:44:19.169727 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ff452fd9c0 pid: 111970 (default app) Sep 12 23:44:19.169994 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: [pid: 111969|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 788 bytes} [Mon Sep 12 23:44:19 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:45:47.397276 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi [None req-aa3f93fe-9984-4fbf-8a0f-794750de2298 None None] Calling method '>' {{(pid=111970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:45:47.398470 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: INFO nova.api.openstack.requestlog [None req-aa3f93fe-9984-4fbf-8a0f-794750de2298 None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002162 Sep 12 23:45:47.398886 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: [pid: 111970|app: 0|req: 1/2] 10.222.0.26 () {54 vars in 931 bytes} [Mon Sep 12 23:45:47 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:45:47.417700 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG dbcounter [-] [111969] Writing DB stats nova_api:SELECT=3 {{(pid=111969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:45:47.418664 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG dbcounter [-] [111969] Writing DB stats nova_cell1:SELECT=3 {{(pid=111969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:45:47.419629 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG dbcounter [-] [111969] Writing DB stats nova_cell0:SELECT=3 {{(pid=111969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:45:47.420493 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG dbcounter [-] [111969] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=111969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:45:48.435286 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi [None req-2d3171ef-1187-44a5-9366-426d67096eec admin admin] Calling method '>' {{(pid=111969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:45:48.472655 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: INFO nova.api.openstack.requestlog [None req-2d3171ef-1187-44a5-9366-426d67096eec admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.066445 Sep 12 23:45:48.473413 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: [pid: 111969|app: 0|req: 2/3] 10.222.0.26 () {60 vars in 1292 bytes} [Mon Sep 12 23:45:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:45:51.586132 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi [None req-aa3f93fe-9984-4fbf-8a0f-794750de2298 None None] Calling method '>' {{(pid=111970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:45:51.587773 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: INFO nova.api.openstack.requestlog [None req-aa3f93fe-9984-4fbf-8a0f-794750de2298 None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001608 Sep 12 23:45:51.599318 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: [pid: 111970|app: 0|req: 2/4] 10.222.0.26 () {54 vars in 931 bytes} [Mon Sep 12 23:45:51 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:45:52.130527 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi [None req-d06353e8-4863-4196-88c9-8be8f733560a admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "disk": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "c1", "ram": 256, "name": "cirros256"}} {{(pid=111969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:45:52.188157 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: INFO nova.api.openstack.requestlog [None req-d06353e8-4863-4196-88c9-8be8f733560a admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.593341 Sep 12 23:45:52.188749 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: [pid: 111969|app: 0|req: 3/5] 10.222.0.26 () {64 vars in 1283 bytes} [Mon Sep 12 23:45:51 2022] POST /compute/v2.1/flavors => generated 407 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 23:45:52.205459 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG dbcounter [-] [111970] Writing DB stats nova_api:SELECT=3 {{(pid=111970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:45:52.208038 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG dbcounter [-] [111970] Writing DB stats nova_cell0:SELECT=3 {{(pid=111970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:45:52.208877 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG dbcounter [-] [111970] Writing DB stats nova_cell1:SELECT=3 {{(pid=111970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:45:52.209589 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG dbcounter [-] [111970] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=111970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:45:52.414704 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi [None req-8c61b6f6-a196-4c57-ab21-85c06e59ad39 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:45:52.490652 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: INFO nova.api.openstack.requestlog [None req-8c61b6f6-a196-4c57-ab21-85c06e59ad39 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.291201 Sep 12 23:45:52.491279 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: [pid: 111970|app: 0|req: 3/6] 10.222.0.26 () {64 vars in 1336 bytes} [Mon Sep 12 23:45:52 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:45:55.302772 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi [None req-d06353e8-4863-4196-88c9-8be8f733560a admin admin] Calling method '>' {{(pid=111969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:45:55.304628 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: INFO nova.api.openstack.requestlog [None req-d06353e8-4863-4196-88c9-8be8f733560a admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002600 Sep 12 23:45:55.305588 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: [pid: 111969|app: 0|req: 4/7] 10.222.0.26 () {54 vars in 931 bytes} [Mon Sep 12 23:45:55 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:45:56.218550 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi [None req-dc2f910c-4588-4291-8898-5c669a15fd5f admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "id": "d1", "disk": 5, "rxtx_factor": 1.0, "name": "ds512M"}} {{(pid=111970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:45:56.261316 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: INFO nova.api.openstack.requestlog [None req-dc2f910c-4588-4291-8898-5c669a15fd5f admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.946272 Sep 12 23:45:56.262088 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: [pid: 111970|app: 0|req: 4/8] 10.222.0.26 () {64 vars in 1283 bytes} [Mon Sep 12 23:45:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 23:45:56.277156 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi [None req-4a36d0d6-8c02-48f7-808f-7bfc127a1fb8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:45:56.323896 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: INFO nova.api.openstack.requestlog [None req-4a36d0d6-8c02-48f7-808f-7bfc127a1fb8 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.050963 Sep 12 23:45:56.331284 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: [pid: 111969|app: 0|req: 5/9] 10.222.0.26 () {64 vars in 1336 bytes} [Mon Sep 12 23:45:56 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:45:59.048783 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi [None req-dc2f910c-4588-4291-8898-5c669a15fd5f admin admin] Calling method '>' {{(pid=111970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:45:59.049827 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: INFO nova.api.openstack.requestlog [None req-dc2f910c-4588-4291-8898-5c669a15fd5f admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Sep 12 23:45:59.050256 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: [pid: 111970|app: 0|req: 5/10] 10.222.0.26 () {54 vars in 931 bytes} [Mon Sep 12 23:45:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 23:45:59.609660 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi [None req-b0d1e386-51a3-415e-899c-cc06a1852ff3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds1G", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "id": "d2", "swap": 0, "vcpus": 1, "ram": 1024}} {{(pid=111969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:45:59.636395 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: INFO nova.api.openstack.requestlog [None req-b0d1e386-51a3-415e-899c-cc06a1852ff3 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.578398 Sep 12 23:45:59.637232 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: [pid: 111969|app: 0|req: 6/11] 10.222.0.26 () {64 vars in 1283 bytes} [Mon Sep 12 23:45:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 23:45:59.653701 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi [None req-acf79188-7283-4191-8eda-aa35c8907b96 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:45:59.688589 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: INFO nova.api.openstack.requestlog [None req-acf79188-7283-4191-8eda-aa35c8907b96 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041564 Sep 12 23:45:59.689175 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: [pid: 111970|app: 0|req: 6/12] 10.222.0.26 () {64 vars in 1336 bytes} [Mon Sep 12 23:45:59 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:46:02.574071 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi [None req-b0d1e386-51a3-415e-899c-cc06a1852ff3 admin admin] Calling method '>' {{(pid=111969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:46:02.575303 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: INFO nova.api.openstack.requestlog [None req-b0d1e386-51a3-415e-899c-cc06a1852ff3 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001709 Sep 12 23:46:02.575925 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: [pid: 111969|app: 0|req: 7/13] 10.222.0.26 () {54 vars in 931 bytes} [Mon Sep 12 23:46:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 23:46:03.273123 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi [None req-0a605ebf-979b-4460-a3cd-a5eec3ca10c7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 2, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "ram": 2048, "name": "ds2G", "os-flavor-access:is_public": true, "id": "d3"}} {{(pid=111970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:46:03.304646 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: INFO nova.api.openstack.requestlog [None req-0a605ebf-979b-4460-a3cd-a5eec3ca10c7 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.721791 Sep 12 23:46:03.307720 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: [pid: 111970|app: 0|req: 7/14] 10.222.0.26 () {64 vars in 1283 bytes} [Mon Sep 12 23:46:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 23:46:03.322085 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi [None req-9ecc3bbf-10a2-4393-982f-583cd57897f1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:46:03.358278 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: INFO nova.api.openstack.requestlog [None req-9ecc3bbf-10a2-4393-982f-583cd57897f1 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041897 Sep 12 23:46:03.363668 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: [pid: 111969|app: 0|req: 8/15] 10.222.0.26 () {64 vars in 1336 bytes} [Mon Sep 12 23:46:03 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:46:06.304476 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi [None req-0a605ebf-979b-4460-a3cd-a5eec3ca10c7 admin admin] Calling method '>' {{(pid=111970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:46:06.305492 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: INFO nova.api.openstack.requestlog [None req-0a605ebf-979b-4460-a3cd-a5eec3ca10c7 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001608 Sep 12 23:46:06.305906 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: [pid: 111970|app: 0|req: 8/16] 10.222.0.26 () {54 vars in 931 bytes} [Mon Sep 12 23:46:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:46:06.834016 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi [None req-84a5d9aa-fc70-4a8a-a811-c0d2ab2a13b7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "swap": 0, "name": "ds4G", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "ram": 4096, "disk": 20, "rxtx_factor": 1.0}} {{(pid=111969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:46:06.862757 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: INFO nova.api.openstack.requestlog [None req-84a5d9aa-fc70-4a8a-a811-c0d2ab2a13b7 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.549433 Sep 12 23:46:06.863412 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: [pid: 111969|app: 0|req: 9/17] 10.222.0.26 () {64 vars in 1283 bytes} [Mon Sep 12 23:46:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 23:46:06.877989 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi [None req-da77c2fa-246c-4e76-88e9-a74e30df34b6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:46:06.911017 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: INFO nova.api.openstack.requestlog [None req-da77c2fa-246c-4e76-88e9-a74e30df34b6 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037437 Sep 12 23:46:06.911901 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: [pid: 111970|app: 0|req: 9/18] 10.222.0.26 () {64 vars in 1336 bytes} [Mon Sep 12 23:46:06 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:46:09.663297 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi [None req-84a5d9aa-fc70-4a8a-a811-c0d2ab2a13b7 admin admin] Calling method '>' {{(pid=111969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:46:09.665005 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: INFO nova.api.openstack.requestlog [None req-84a5d9aa-fc70-4a8a-a811-c0d2ab2a13b7 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002362 Sep 12 23:46:09.665915 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: [pid: 111969|app: 0|req: 10/19] 10.222.0.26 () {54 vars in 931 bytes} [Mon Sep 12 23:46:09 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:46:10.252861 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi [None req-3ad508fe-66de-4ec9-b17d-94cc57298812 admin admin] Calling method '>' {{(pid=111970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:46:10.314991 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: INFO nova.api.openstack.requestlog [None req-3ad508fe-66de-4ec9-b17d-94cc57298812 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.641309 Sep 12 23:46:10.316432 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: [pid: 111970|app: 0|req: 10/20] 10.222.0.26 () {60 vars in 1292 bytes} [Mon Sep 12 23:46:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:46:13.370938 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi [None req-84a5d9aa-fc70-4a8a-a811-c0d2ab2a13b7 admin admin] Calling method '>' {{(pid=111969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:46:13.372937 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: INFO nova.api.openstack.requestlog [None req-84a5d9aa-fc70-4a8a-a811-c0d2ab2a13b7 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002795 Sep 12 23:46:13.373697 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: [pid: 111969|app: 0|req: 11/21] 10.222.0.26 () {54 vars in 931 bytes} [Mon Sep 12 23:46:13 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:46:13.954204 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi [None req-faf1f9c1-91ee-4278-b2ac-be2145445f28 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 512, "rxtx_factor": 1.0, "name": "m1.tiny", "disk": 1, "id": "1", "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=111970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:46:13.990272 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: INFO nova.api.openstack.requestlog [None req-faf1f9c1-91ee-4278-b2ac-be2145445f28 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.609337 Sep 12 23:46:13.991418 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: [pid: 111970|app: 0|req: 11/22] 10.222.0.26 () {64 vars in 1283 bytes} [Mon Sep 12 23:46:13 2022] POST /compute/v2.1/flavors => generated 402 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 12 23:46:14.009182 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi [None req-c47a31aa-0522-4928-82a0-21860d9fb4f4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:46:14.077644 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: INFO nova.api.openstack.requestlog [None req-c47a31aa-0522-4928-82a0-21860d9fb4f4 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074132 Sep 12 23:46:14.078698 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: [pid: 111969|app: 0|req: 12/23] 10.222.0.26 () {64 vars in 1333 bytes} [Mon Sep 12 23:46:14 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:46:16.935308 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi [None req-faf1f9c1-91ee-4278-b2ac-be2145445f28 admin admin] Calling method '>' {{(pid=111970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:46:16.936324 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: INFO nova.api.openstack.requestlog [None req-faf1f9c1-91ee-4278-b2ac-be2145445f28 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Sep 12 23:46:16.936732 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: [pid: 111970|app: 0|req: 12/24] 10.222.0.26 () {54 vars in 931 bytes} [Mon Sep 12 23:46:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:46:17.491308 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi [None req-b26cd665-f753-432d-8c69-529a133bd47e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "name": "m1.small", "rxtx_factor": 1.0, "ram": 2048, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "2", "swap": 0}} {{(pid=111969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:46:17.497414 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG dbcounter [-] [111969] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=6,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=111969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:46:17.515702 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: INFO nova.api.openstack.requestlog [None req-b26cd665-f753-432d-8c69-529a133bd47e admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.572413 Sep 12 23:46:17.516274 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: [pid: 111969|app: 0|req: 13/25] 10.222.0.26 () {64 vars in 1283 bytes} [Mon Sep 12 23:46:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 23:46:17.535045 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi [None req-4c71a7bf-3820-45b3-8642-41887d59cf85 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:46:17.581206 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: INFO nova.api.openstack.requestlog [None req-4c71a7bf-3820-45b3-8642-41887d59cf85 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.053277 Sep 12 23:46:17.587291 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: [pid: 111970|app: 0|req: 13/26] 10.222.0.26 () {64 vars in 1333 bytes} [Mon Sep 12 23:46:17 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:46:20.464027 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi [None req-b26cd665-f753-432d-8c69-529a133bd47e admin admin] Calling method '>' {{(pid=111969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:46:20.465884 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: INFO nova.api.openstack.requestlog [None req-b26cd665-f753-432d-8c69-529a133bd47e admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002720 Sep 12 23:46:20.480034 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: [pid: 111969|app: 0|req: 14/27] 10.222.0.26 () {54 vars in 931 bytes} [Mon Sep 12 23:46:20 2022] GET /compute/v2.1 => generated 388 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:46:21.207670 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi [None req-70da04db-da81-4530-80fa-27d17e327707 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "swap": 0, "disk": 40, "vcpus": 2, "ram": 4096, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.medium"}} {{(pid=111970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:46:21.248357 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: INFO nova.api.openstack.requestlog [None req-70da04db-da81-4530-80fa-27d17e327707 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.739702 Sep 12 23:46:21.255356 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: [pid: 111970|app: 0|req: 14/28] 10.222.0.26 () {64 vars in 1283 bytes} [Mon Sep 12 23:46:20 2022] POST /compute/v2.1/flavors => generated 406 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 23:46:21.262247 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi [None req-e359c625-aeb6-46e5-9506-9c3c9d2ab094 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:46:21.302721 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: INFO nova.api.openstack.requestlog [None req-e359c625-aeb6-46e5-9506-9c3c9d2ab094 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044385 Sep 12 23:46:21.304120 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: [pid: 111969|app: 0|req: 15/29] 10.222.0.26 () {64 vars in 1333 bytes} [Mon Sep 12 23:46:21 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:46:24.114412 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi [None req-70da04db-da81-4530-80fa-27d17e327707 admin admin] Calling method '>' {{(pid=111970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:46:24.116172 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: INFO nova.api.openstack.requestlog [None req-70da04db-da81-4530-80fa-27d17e327707 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002321 Sep 12 23:46:24.116978 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: [pid: 111970|app: 0|req: 15/30] 10.222.0.26 () {54 vars in 931 bytes} [Mon Sep 12 23:46:24 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 23:46:24.887522 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi [None req-9cc2611f-19c6-4243-9bd7-54481e7c3215 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "disk": 80, "rxtx_factor": 1.0, "ram": 8192, "swap": 0, "vcpus": 4}} {{(pid=111969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:46:24.913154 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: INFO nova.api.openstack.requestlog [None req-9cc2611f-19c6-4243-9bd7-54481e7c3215 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.789723 Sep 12 23:46:24.914120 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: [pid: 111969|app: 0|req: 16/31] 10.222.0.26 () {64 vars in 1283 bytes} [Mon Sep 12 23:46:24 2022] POST /compute/v2.1/flavors => generated 405 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 23:46:24.931112 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi [None req-ef672262-99e9-4c51-b04c-3a6df42934d9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:46:24.937012 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG dbcounter [-] [111970] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=111970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:46:24.965276 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: INFO nova.api.openstack.requestlog [None req-ef672262-99e9-4c51-b04c-3a6df42934d9 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038062 Sep 12 23:46:24.966233 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: [pid: 111970|app: 0|req: 16/32] 10.222.0.26 () {64 vars in 1333 bytes} [Mon Sep 12 23:46:24 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:46:27.702423 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi [None req-9cc2611f-19c6-4243-9bd7-54481e7c3215 admin admin] Calling method '>' {{(pid=111969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:46:27.703407 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: INFO nova.api.openstack.requestlog [None req-9cc2611f-19c6-4243-9bd7-54481e7c3215 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Sep 12 23:46:27.703808 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: [pid: 111969|app: 0|req: 17/33] 10.222.0.26 () {54 vars in 931 bytes} [Mon Sep 12 23:46:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:46:28.224708 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi [None req-7c75b33c-0037-4030-8cc8-90692bb06684 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 16384, "vcpus": 8, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "id": "5", "disk": 160}} {{(pid=111970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:46:28.247087 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: INFO nova.api.openstack.requestlog [None req-7c75b33c-0037-4030-8cc8-90692bb06684 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.536668 Sep 12 23:46:28.247707 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: [pid: 111970|app: 0|req: 17/34] 10.222.0.26 () {64 vars in 1283 bytes} [Mon Sep 12 23:46:27 2022] POST /compute/v2.1/flavors => generated 408 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 12 23:46:28.260178 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi [None req-d3769364-e013-4b34-bd67-82c6c083085f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=111969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:46:28.289129 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: INFO nova.api.openstack.requestlog [None req-d3769364-e013-4b34-bd67-82c6c083085f admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032723 Sep 12 23:46:28.290861 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: [pid: 111969|app: 0|req: 18/35] 10.222.0.26 () {64 vars in 1333 bytes} [Mon Sep 12 23:46:28 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:46:43.949687 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi [None req-7c75b33c-0037-4030-8cc8-90692bb06684 admin admin] Calling method '>' {{(pid=111970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:46:43.950744 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: INFO nova.api.openstack.requestlog [None req-7c75b33c-0037-4030-8cc8-90692bb06684 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Sep 12 23:46:43.951268 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: [pid: 111970|app: 0|req: 18/36] 10.222.0.26 () {54 vars in 931 bytes} [Mon Sep 12 23:46:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:46:43.963546 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG dbcounter [-] [111969] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=17,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=111969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:46:44.368986 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi [None req-7ba32f75-726d-4f0d-b091-d2363516cad0 admin admin] Calling method '>' {{(pid=111969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:46:44.387761 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: INFO nova.api.openstack.requestlog [None req-7ba32f75-726d-4f0d-b091-d2363516cad0 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.429364 Sep 12 23:46:44.388324 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: [pid: 111969|app: 0|req: 19/37] 10.222.0.26 () {60 vars in 1292 bytes} [Mon Sep 12 23:46:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:46:45.728260 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi [None req-7c75b33c-0037-4030-8cc8-90692bb06684 admin admin] Calling method '>' {{(pid=111970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:46:45.729290 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: INFO nova.api.openstack.requestlog [None req-7c75b33c-0037-4030-8cc8-90692bb06684 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001561 Sep 12 23:46:45.729963 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: [pid: 111970|app: 0|req: 19/38] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Sep 12 23:46:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:46:46.288691 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi [None req-cb774208-82c3-4519-aed8-fec2f973e9c0 admin admin] Calling method '>' {{(pid=111969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:46:46.294780 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: INFO nova.api.openstack.wsgi [None req-cb774208-82c3-4519-aed8-fec2f973e9c0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 12 23:46:46.298001 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi [None req-cb774208-82c3-4519-aed8-fec2f973e9c0 admin admin] Request method failure captured: Sep 12 23:46:46.298001 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 12 23:46:46.298001 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: Accept: application/json Sep 12 23:46:46.298001 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: Accept-Encoding: gzip, deflate Sep 12 23:46:46.298001 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: Connection: keep-alive Sep 12 23:46:46.298001 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: Content-Length: 0 Sep 12 23:46:46.298001 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: Host: 10.222.0.26 Sep 12 23:46:46.298001 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: Openstack-Api-Version: compute 2.92 Sep 12 23:46:46.298001 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: Openstack-System-Scope: None Sep 12 23:46:46.298001 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: User-Agent: python-novaclient Sep 12 23:46:46.298001 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-Auth-Token: gAAAAABjH8TlnwFi8-kPJ5UCmwYxsHF2ncyL7D2BPHpI8pszPqVPp1Vs1E3HdTQap6eaZFtQuLq1nQ5deVR-_eQa4gAztz34y-pAPIc0TXxfswdC79sS8e-5aku4Z3nZyBaZKJt6GHsRRnK-iRUdkF7VraNCLIcA9Xz5gEukIrPLqnNzDdb7jm8 Sep 12 23:46:46.298001 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-Domain-Id: None Sep 12 23:46:46.298001 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-Domain-Name: None Sep 12 23:46:46.298001 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-Identity-Status: Confirmed Sep 12 23:46:46.298001 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-Is-Admin-Project: True Sep 12 23:46:46.298001 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-Openstack-Nova-Api-Version: 2.92 Sep 12 23:46:46.298001 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-Project-Domain-Id: default Sep 12 23:46:46.298001 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-Project-Domain-Name: Default Sep 12 23:46:46.298001 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-Project-Id: 16141215d11e48819148a2d135301f22 Sep 12 23:46:46.298001 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-Project-Name: admin Sep 12 23:46:46.298001 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-Role: admin,member,reader Sep 12 23:46:46.298001 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-Roles: admin,member,reader Sep 12 23:46:46.299527 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16141215d11e48819148a2d135301f22"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16141215d11e48819148a2d135301f22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_16141215d11e48819148a2d135301f22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/16141215d11e48819148a2d135301f22"}]}] Sep 12 23:46:46.299527 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-Tenant: admin Sep 12 23:46:46.299527 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-Tenant-Id: 16141215d11e48819148a2d135301f22 Sep 12 23:46:46.299527 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-Tenant-Name: admin Sep 12 23:46:46.299527 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-User: admin Sep 12 23:46:46.299527 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-User-Domain-Id: default Sep 12 23:46:46.299527 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-User-Domain-Name: Default Sep 12 23:46:46.299527 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-User-Id: f9f809fdc6b04f0ca4d4c2bc46e0a712 Sep 12 23:46:46.299527 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-User-Name: admin Sep 12 23:46:46.299527 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: method: > Sep 12 23:46:46.299527 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: exception: Flavor 42 could not be found. Sep 12 23:46:46.299527 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: action_args: {'id': '42'} Sep 12 23:46:46.299527 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: {{(pid=111969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:46:46.299527 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:46:46.300467 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 12 23:46:46.300467 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 12 23:46:46.300467 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 12 23:46:46.300467 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 12 23:46:46.300467 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 12 23:46:46.300467 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 12 23:46:46.300467 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 12 23:46:46.300467 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 12 23:46:46.300467 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 12 23:46:46.300467 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:46:46.300467 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 12 23:46:46.300467 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 12 23:46:46.300467 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 12 23:46:46.300467 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi Sep 12 23:46:46.300467 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:46:46.300467 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi Sep 12 23:46:46.300467 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:46:46.300467 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:46:46.300467 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:46:46.301707 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:46:46.301707 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:46:46.301707 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:46:46.301707 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:46:46.301707 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 12 23:46:46.301707 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:46:46.301707 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 12 23:46:46.301707 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi Sep 12 23:46:46.301707 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:46:46.301707 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi Sep 12 23:46:46.301707 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:46:46.301707 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:46:46.301707 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:46:46.301707 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:46:46.301707 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:46:46.301707 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 12 23:46:46.301707 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi Sep 12 23:46:46.301707 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi [None req-cb774208-82c3-4519-aed8-fec2f973e9c0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=111969) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:46:46.302945 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: INFO nova.api.openstack.requestlog [None req-cb774208-82c3-4519-aed8-fec2f973e9c0 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.428102 Sep 12 23:46:46.302945 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: [pid: 111969|app: 0|req: 20/39] 10.222.0.26 () {60 vars in 1190 bytes} [Mon Sep 12 23:46:45 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 429 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 12 23:46:46.310131 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi [None req-49018140-7dfa-4442-850c-7cb91bf2b527 admin admin] Calling method '>' {{(pid=111970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:46:46.314429 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG dbcounter [-] [111970] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=111970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:46:46.342614 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: INFO nova.api.openstack.requestlog [None req-49018140-7dfa-4442-850c-7cb91bf2b527 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.035899 Sep 12 23:46:46.343280 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: [pid: 111970|app: 0|req: 20/40] 10.222.0.26 () {60 vars in 1210 bytes} [Mon Sep 12 23:46:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:46:46.357581 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi [None req-c94bbb41-fad1-426e-ba08-5c80851c01e1 admin admin] Calling method '>' {{(pid=111969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:46:46.379793 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: INFO nova.api.openstack.requestlog [None req-c94bbb41-fad1-426e-ba08-5c80851c01e1 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027069 Sep 12 23:46:46.380362 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: [pid: 111969|app: 0|req: 21/41] 10.222.0.26 () {60 vars in 1210 bytes} [Mon Sep 12 23:46:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 23:46:46.390484 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi [None req-2797ac13-eb0d-4776-90d9-cbee8aef3cf5 admin admin] Calling method '>' {{(pid=111970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:46:46.396702 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: INFO nova.api.openstack.wsgi [None req-2797ac13-eb0d-4776-90d9-cbee8aef3cf5 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 12 23:46:46.400075 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi [None req-2797ac13-eb0d-4776-90d9-cbee8aef3cf5 admin admin] Request method failure captured: Sep 12 23:46:46.400075 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 12 23:46:46.400075 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: Accept: application/json Sep 12 23:46:46.400075 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: Accept-Encoding: gzip, deflate Sep 12 23:46:46.400075 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: Connection: keep-alive Sep 12 23:46:46.400075 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: Content-Length: 0 Sep 12 23:46:46.400075 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: Host: 10.222.0.26 Sep 12 23:46:46.400075 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: Openstack-Api-Version: compute 2.92 Sep 12 23:46:46.400075 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: Openstack-System-Scope: None Sep 12 23:46:46.400075 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: User-Agent: python-novaclient Sep 12 23:46:46.400075 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-Auth-Token: gAAAAABjH8TlnwFi8-kPJ5UCmwYxsHF2ncyL7D2BPHpI8pszPqVPp1Vs1E3HdTQap6eaZFtQuLq1nQ5deVR-_eQa4gAztz34y-pAPIc0TXxfswdC79sS8e-5aku4Z3nZyBaZKJt6GHsRRnK-iRUdkF7VraNCLIcA9Xz5gEukIrPLqnNzDdb7jm8 Sep 12 23:46:46.400075 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-Domain-Id: None Sep 12 23:46:46.400075 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-Domain-Name: None Sep 12 23:46:46.400075 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-Identity-Status: Confirmed Sep 12 23:46:46.400075 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-Is-Admin-Project: True Sep 12 23:46:46.400075 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-Openstack-Nova-Api-Version: 2.92 Sep 12 23:46:46.400075 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-Project-Domain-Id: default Sep 12 23:46:46.400075 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-Project-Domain-Name: Default Sep 12 23:46:46.400075 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-Project-Id: 16141215d11e48819148a2d135301f22 Sep 12 23:46:46.400075 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-Project-Name: admin Sep 12 23:46:46.400075 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-Role: admin,member,reader Sep 12 23:46:46.400075 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-Roles: admin,member,reader Sep 12 23:46:46.401535 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16141215d11e48819148a2d135301f22"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16141215d11e48819148a2d135301f22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_16141215d11e48819148a2d135301f22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/16141215d11e48819148a2d135301f22"}]}] Sep 12 23:46:46.401535 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-Tenant: admin Sep 12 23:46:46.401535 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-Tenant-Id: 16141215d11e48819148a2d135301f22 Sep 12 23:46:46.401535 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-Tenant-Name: admin Sep 12 23:46:46.401535 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-User: admin Sep 12 23:46:46.401535 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-User-Domain-Id: default Sep 12 23:46:46.401535 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-User-Domain-Name: Default Sep 12 23:46:46.401535 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-User-Id: f9f809fdc6b04f0ca4d4c2bc46e0a712 Sep 12 23:46:46.401535 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-User-Name: admin Sep 12 23:46:46.401535 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: method: > Sep 12 23:46:46.401535 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: exception: Flavor 42 could not be found. Sep 12 23:46:46.401535 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: action_args: {'id': '42'} Sep 12 23:46:46.401535 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: {{(pid=111970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:46:46.401535 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:46:46.402587 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 12 23:46:46.402587 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 12 23:46:46.402587 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 12 23:46:46.402587 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 12 23:46:46.402587 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 12 23:46:46.402587 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 12 23:46:46.402587 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 12 23:46:46.402587 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 12 23:46:46.402587 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 12 23:46:46.402587 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:46:46.402587 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 12 23:46:46.402587 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 12 23:46:46.402587 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 12 23:46:46.402587 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi Sep 12 23:46:46.402587 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:46:46.402587 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi Sep 12 23:46:46.402587 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:46:46.402587 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:46:46.402587 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:46:46.404175 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:46:46.404175 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:46:46.404175 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:46:46.404175 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:46:46.404175 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 12 23:46:46.404175 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:46:46.404175 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 12 23:46:46.404175 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi Sep 12 23:46:46.404175 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:46:46.404175 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi Sep 12 23:46:46.404175 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:46:46.404175 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:46:46.404175 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:46:46.404175 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:46:46.404175 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:46:46.404175 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 12 23:46:46.404175 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi Sep 12 23:46:46.404175 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi [None req-2797ac13-eb0d-4776-90d9-cbee8aef3cf5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=111970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:46:46.405487 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: INFO nova.api.openstack.requestlog [None req-2797ac13-eb0d-4776-90d9-cbee8aef3cf5 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014675 Sep 12 23:46:46.405487 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: [pid: 111970|app: 0|req: 21/42] 10.222.0.26 () {60 vars in 1190 bytes} [Mon Sep 12 23:46:46 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 12 23:46:47.659518 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi [None req-c94bbb41-fad1-426e-ba08-5c80851c01e1 admin admin] Calling method '>' {{(pid=111969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:46:47.660630 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: INFO nova.api.openstack.requestlog [None req-c94bbb41-fad1-426e-ba08-5c80851c01e1 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001576 Sep 12 23:46:47.661044 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: [pid: 111969|app: 0|req: 22/43] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Sep 12 23:46:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:46:48.205465 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi [None req-287a00e1-66ca-4997-9d07-11b03cf4b196 admin admin] Calling method '>' {{(pid=111970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:46:48.210772 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: INFO nova.api.openstack.wsgi [None req-287a00e1-66ca-4997-9d07-11b03cf4b196 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 12 23:46:48.212587 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi [None req-287a00e1-66ca-4997-9d07-11b03cf4b196 admin admin] Request method failure captured: Sep 12 23:46:48.212587 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 12 23:46:48.212587 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: Accept: application/json Sep 12 23:46:48.212587 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: Accept-Encoding: gzip, deflate Sep 12 23:46:48.212587 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: Connection: keep-alive Sep 12 23:46:48.212587 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: Content-Length: 0 Sep 12 23:46:48.212587 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: Host: 10.222.0.26 Sep 12 23:46:48.212587 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: Openstack-Api-Version: compute 2.92 Sep 12 23:46:48.212587 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: Openstack-System-Scope: None Sep 12 23:46:48.212587 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: User-Agent: python-novaclient Sep 12 23:46:48.212587 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-Auth-Token: gAAAAABjH8TnaqnGjvG1-W1bcaWM8UYXkKKXSpCtTZYaLv-bRkEjC4mHhx3Eb4FoCVtY8eoTdIdIr1ujQ7h3Rg1dinKoTeZybl0covQna7lv5b26Ud8H7BfNczQhYHcaEEnHQbXvFnt3b401IIT_hr6_Gy8rTz7p4THaHtIWi3PYo7jYPlaeOrQ Sep 12 23:46:48.212587 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-Domain-Id: None Sep 12 23:46:48.212587 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-Domain-Name: None Sep 12 23:46:48.212587 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-Identity-Status: Confirmed Sep 12 23:46:48.212587 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-Is-Admin-Project: True Sep 12 23:46:48.212587 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-Openstack-Nova-Api-Version: 2.92 Sep 12 23:46:48.212587 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-Project-Domain-Id: default Sep 12 23:46:48.212587 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-Project-Domain-Name: Default Sep 12 23:46:48.212587 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-Project-Id: 16141215d11e48819148a2d135301f22 Sep 12 23:46:48.212587 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-Project-Name: admin Sep 12 23:46:48.212587 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-Role: admin,member,reader Sep 12 23:46:48.212587 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-Roles: admin,member,reader Sep 12 23:46:48.214043 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16141215d11e48819148a2d135301f22"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16141215d11e48819148a2d135301f22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_16141215d11e48819148a2d135301f22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/16141215d11e48819148a2d135301f22"}]}] Sep 12 23:46:48.214043 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-Tenant: admin Sep 12 23:46:48.214043 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-Tenant-Id: 16141215d11e48819148a2d135301f22 Sep 12 23:46:48.214043 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-Tenant-Name: admin Sep 12 23:46:48.214043 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-User: admin Sep 12 23:46:48.214043 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-User-Domain-Id: default Sep 12 23:46:48.214043 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-User-Domain-Name: Default Sep 12 23:46:48.214043 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-User-Id: f9f809fdc6b04f0ca4d4c2bc46e0a712 Sep 12 23:46:48.214043 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-User-Name: admin Sep 12 23:46:48.214043 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: method: > Sep 12 23:46:48.214043 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: exception: Flavor 84 could not be found. Sep 12 23:46:48.214043 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: action_args: {'id': '84'} Sep 12 23:46:48.214043 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: {{(pid=111970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:46:48.214043 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:46:48.214843 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 12 23:46:48.214843 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 12 23:46:48.214843 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 12 23:46:48.214843 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 12 23:46:48.214843 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 12 23:46:48.214843 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 12 23:46:48.214843 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 12 23:46:48.214843 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 12 23:46:48.214843 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 12 23:46:48.214843 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:46:48.214843 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 12 23:46:48.214843 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 12 23:46:48.214843 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 12 23:46:48.214843 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi Sep 12 23:46:48.214843 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:46:48.214843 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi Sep 12 23:46:48.214843 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:46:48.214843 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:46:48.214843 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:46:48.216051 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:46:48.216051 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:46:48.216051 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:46:48.216051 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:46:48.216051 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 12 23:46:48.216051 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:46:48.216051 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 12 23:46:48.216051 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi Sep 12 23:46:48.216051 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:46:48.216051 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi Sep 12 23:46:48.216051 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:46:48.216051 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:46:48.216051 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:46:48.216051 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:46:48.216051 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:46:48.216051 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 12 23:46:48.216051 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi Sep 12 23:46:48.216051 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi [None req-287a00e1-66ca-4997-9d07-11b03cf4b196 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=111970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:46:48.217191 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: INFO nova.api.openstack.requestlog [None req-287a00e1-66ca-4997-9d07-11b03cf4b196 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.414763 Sep 12 23:46:48.217191 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: [pid: 111970|app: 0|req: 22/44] 10.222.0.26 () {60 vars in 1190 bytes} [Mon Sep 12 23:46:47 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 416 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 12 23:46:48.224105 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi [None req-d3691ded-6193-42bc-a233-c6bcad41771b admin admin] Calling method '>' {{(pid=111969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:46:48.239379 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: INFO nova.api.openstack.requestlog [None req-d3691ded-6193-42bc-a233-c6bcad41771b admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018866 Sep 12 23:46:48.239948 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: [pid: 111969|app: 0|req: 23/45] 10.222.0.26 () {60 vars in 1210 bytes} [Mon Sep 12 23:46:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:46:48.249998 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi [None req-81d9e18a-31ac-498e-8fa1-06821c6dd42e admin admin] Calling method '>' {{(pid=111970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:46:48.266017 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: INFO nova.api.openstack.requestlog [None req-81d9e18a-31ac-498e-8fa1-06821c6dd42e admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019578 Sep 12 23:46:48.266559 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: [pid: 111970|app: 0|req: 23/46] 10.222.0.26 () {60 vars in 1210 bytes} [Mon Sep 12 23:46:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:46:48.276349 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi [None req-5c93722a-1f64-41f7-9555-a36c706c744c admin admin] Calling method '>' {{(pid=111969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:46:48.281655 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: INFO nova.api.openstack.wsgi [None req-5c93722a-1f64-41f7-9555-a36c706c744c admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 12 23:46:48.283191 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi [None req-5c93722a-1f64-41f7-9555-a36c706c744c admin admin] Request method failure captured: Sep 12 23:46:48.283191 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 12 23:46:48.283191 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: Accept: application/json Sep 12 23:46:48.283191 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: Accept-Encoding: gzip, deflate Sep 12 23:46:48.283191 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: Connection: keep-alive Sep 12 23:46:48.283191 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: Content-Length: 0 Sep 12 23:46:48.283191 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: Host: 10.222.0.26 Sep 12 23:46:48.283191 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: Openstack-Api-Version: compute 2.92 Sep 12 23:46:48.283191 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: Openstack-System-Scope: None Sep 12 23:46:48.283191 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: User-Agent: python-novaclient Sep 12 23:46:48.283191 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-Auth-Token: gAAAAABjH8TnaqnGjvG1-W1bcaWM8UYXkKKXSpCtTZYaLv-bRkEjC4mHhx3Eb4FoCVtY8eoTdIdIr1ujQ7h3Rg1dinKoTeZybl0covQna7lv5b26Ud8H7BfNczQhYHcaEEnHQbXvFnt3b401IIT_hr6_Gy8rTz7p4THaHtIWi3PYo7jYPlaeOrQ Sep 12 23:46:48.283191 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-Domain-Id: None Sep 12 23:46:48.283191 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-Domain-Name: None Sep 12 23:46:48.283191 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-Identity-Status: Confirmed Sep 12 23:46:48.283191 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-Is-Admin-Project: True Sep 12 23:46:48.283191 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-Openstack-Nova-Api-Version: 2.92 Sep 12 23:46:48.283191 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-Project-Domain-Id: default Sep 12 23:46:48.283191 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-Project-Domain-Name: Default Sep 12 23:46:48.283191 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-Project-Id: 16141215d11e48819148a2d135301f22 Sep 12 23:46:48.283191 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-Project-Name: admin Sep 12 23:46:48.283191 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-Role: admin,member,reader Sep 12 23:46:48.283191 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-Roles: admin,member,reader Sep 12 23:46:48.284870 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16141215d11e48819148a2d135301f22"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16141215d11e48819148a2d135301f22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_16141215d11e48819148a2d135301f22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/16141215d11e48819148a2d135301f22"}]}] Sep 12 23:46:48.284870 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-Tenant: admin Sep 12 23:46:48.284870 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-Tenant-Id: 16141215d11e48819148a2d135301f22 Sep 12 23:46:48.284870 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-Tenant-Name: admin Sep 12 23:46:48.284870 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-User: admin Sep 12 23:46:48.284870 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-User-Domain-Id: default Sep 12 23:46:48.284870 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-User-Domain-Name: Default Sep 12 23:46:48.284870 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-User-Id: f9f809fdc6b04f0ca4d4c2bc46e0a712 Sep 12 23:46:48.284870 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-User-Name: admin Sep 12 23:46:48.284870 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: method: > Sep 12 23:46:48.284870 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: exception: Flavor 84 could not be found. Sep 12 23:46:48.284870 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: action_args: {'id': '84'} Sep 12 23:46:48.284870 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: {{(pid=111969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:46:48.284870 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:46:48.285854 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 12 23:46:48.285854 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 12 23:46:48.285854 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 12 23:46:48.285854 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 12 23:46:48.285854 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 12 23:46:48.285854 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 12 23:46:48.285854 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 12 23:46:48.285854 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 12 23:46:48.285854 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 12 23:46:48.285854 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:46:48.285854 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 12 23:46:48.285854 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 12 23:46:48.285854 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 12 23:46:48.285854 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi Sep 12 23:46:48.285854 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:46:48.285854 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi Sep 12 23:46:48.285854 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:46:48.285854 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:46:48.285854 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:46:48.287274 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:46:48.287274 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:46:48.287274 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:46:48.287274 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:46:48.287274 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 12 23:46:48.287274 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:46:48.287274 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 12 23:46:48.287274 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi Sep 12 23:46:48.287274 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:46:48.287274 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi Sep 12 23:46:48.287274 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:46:48.287274 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:46:48.287274 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:46:48.287274 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:46:48.287274 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:46:48.287274 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 12 23:46:48.287274 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi Sep 12 23:46:48.287274 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi [None req-5c93722a-1f64-41f7-9555-a36c706c744c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=111969) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:46:48.288643 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: INFO nova.api.openstack.requestlog [None req-5c93722a-1f64-41f7-9555-a36c706c744c admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012026 Sep 12 23:46:48.288643 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: [pid: 111969|app: 0|req: 24/47] 10.222.0.26 () {60 vars in 1190 bytes} [Mon Sep 12 23:46:48 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 12 23:46:49.562593 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi [None req-81d9e18a-31ac-498e-8fa1-06821c6dd42e admin admin] Calling method '>' {{(pid=111970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:46:49.563658 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: INFO nova.api.openstack.requestlog [None req-81d9e18a-31ac-498e-8fa1-06821c6dd42e admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Sep 12 23:46:49.564061 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: [pid: 111970|app: 0|req: 24/48] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Sep 12 23:46:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:46:50.234615 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi [None req-277aff10-1db2-4695-a931-0d6c5169aafe admin admin] Calling method '>' {{(pid=111969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:46:50.240985 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: INFO nova.api.openstack.wsgi [None req-277aff10-1db2-4695-a931-0d6c5169aafe admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 12 23:46:50.242451 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi [None req-277aff10-1db2-4695-a931-0d6c5169aafe admin admin] Request method failure captured: Sep 12 23:46:50.242451 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 12 23:46:50.242451 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: Accept: application/json Sep 12 23:46:50.242451 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: Accept-Encoding: gzip, deflate Sep 12 23:46:50.242451 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: Connection: keep-alive Sep 12 23:46:50.242451 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: Content-Length: 0 Sep 12 23:46:50.242451 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: Host: 10.222.0.26 Sep 12 23:46:50.242451 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: Openstack-Api-Version: compute 2.92 Sep 12 23:46:50.242451 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: Openstack-System-Scope: None Sep 12 23:46:50.242451 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: User-Agent: python-novaclient Sep 12 23:46:50.242451 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-Auth-Token: gAAAAABjH8Tpu1XEtRqADybbQl6jwJZyZFxP56iR-nvy8ZJuxdPSki66BhLp2aThi2Mvdirum1H6Dj_cYYDnWKzGNTch-mq6NEQm1FsuGotqzD0501pkI9m4zcwVZLhYzhstBYwy_XBnIv5Z6G0cafOfH4cjtpdv2g1WAweXe4qMCDwmsIHZkDQ Sep 12 23:46:50.242451 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-Domain-Id: None Sep 12 23:46:50.242451 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-Domain-Name: None Sep 12 23:46:50.242451 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-Identity-Status: Confirmed Sep 12 23:46:50.242451 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-Is-Admin-Project: True Sep 12 23:46:50.242451 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-Openstack-Nova-Api-Version: 2.92 Sep 12 23:46:50.242451 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-Project-Domain-Id: default Sep 12 23:46:50.242451 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-Project-Domain-Name: Default Sep 12 23:46:50.242451 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-Project-Id: 16141215d11e48819148a2d135301f22 Sep 12 23:46:50.242451 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-Project-Name: admin Sep 12 23:46:50.242451 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-Role: admin,member,reader Sep 12 23:46:50.242451 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-Roles: admin,member,reader Sep 12 23:46:50.244121 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16141215d11e48819148a2d135301f22"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16141215d11e48819148a2d135301f22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_16141215d11e48819148a2d135301f22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/16141215d11e48819148a2d135301f22"}]}] Sep 12 23:46:50.244121 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-Tenant: admin Sep 12 23:46:50.244121 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-Tenant-Id: 16141215d11e48819148a2d135301f22 Sep 12 23:46:50.244121 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-Tenant-Name: admin Sep 12 23:46:50.244121 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-User: admin Sep 12 23:46:50.244121 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-User-Domain-Id: default Sep 12 23:46:50.244121 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-User-Domain-Name: Default Sep 12 23:46:50.244121 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-User-Id: f9f809fdc6b04f0ca4d4c2bc46e0a712 Sep 12 23:46:50.244121 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: X-User-Name: admin Sep 12 23:46:50.244121 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: method: > Sep 12 23:46:50.244121 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: exception: Flavor 451 could not be found. Sep 12 23:46:50.244121 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: action_args: {'id': '451'} Sep 12 23:46:50.244121 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: {{(pid=111969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:46:50.244121 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:46:50.244962 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 12 23:46:50.244962 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 12 23:46:50.244962 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 12 23:46:50.244962 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 12 23:46:50.244962 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 12 23:46:50.244962 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 12 23:46:50.244962 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 12 23:46:50.244962 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 12 23:46:50.244962 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 12 23:46:50.244962 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:46:50.244962 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 12 23:46:50.244962 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 12 23:46:50.244962 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 12 23:46:50.244962 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi Sep 12 23:46:50.244962 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:46:50.244962 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi Sep 12 23:46:50.244962 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:46:50.244962 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:46:50.244962 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:46:50.245973 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:46:50.245973 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:46:50.245973 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:46:50.245973 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:46:50.245973 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 12 23:46:50.245973 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:46:50.245973 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 12 23:46:50.245973 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi Sep 12 23:46:50.245973 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:46:50.245973 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi Sep 12 23:46:50.245973 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:46:50.245973 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:46:50.245973 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:46:50.245973 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:46:50.245973 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:46:50.245973 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 12 23:46:50.245973 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: ERROR nova.api.openstack.wsgi Sep 12 23:46:50.245973 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi [None req-277aff10-1db2-4695-a931-0d6c5169aafe admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=111969) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:46:50.247095 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: INFO nova.api.openstack.requestlog [None req-277aff10-1db2-4695-a931-0d6c5169aafe admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.543898 Sep 12 23:46:50.247095 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: [pid: 111969|app: 0|req: 25/49] 10.222.0.26 () {60 vars in 1193 bytes} [Mon Sep 12 23:46:49 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 545 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 12 23:46:50.254177 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi [None req-5f864ded-b37c-4176-aa4d-6915c75a8012 admin admin] Calling method '>' {{(pid=111970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:46:50.269556 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: INFO nova.api.openstack.requestlog [None req-5f864ded-b37c-4176-aa4d-6915c75a8012 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018995 Sep 12 23:46:50.270151 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: [pid: 111970|app: 0|req: 25/50] 10.222.0.26 () {60 vars in 1210 bytes} [Mon Sep 12 23:46:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:46:50.280259 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi [None req-13c6e784-c9d7-4647-9af0-70aa68c46648 admin admin] Calling method '>' {{(pid=111969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:46:50.296155 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: INFO nova.api.openstack.requestlog [None req-13c6e784-c9d7-4647-9af0-70aa68c46648 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019521 Sep 12 23:46:50.296773 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: [pid: 111969|app: 0|req: 26/51] 10.222.0.26 () {60 vars in 1210 bytes} [Mon Sep 12 23:46:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:46:50.307109 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi [None req-3cce1759-94a8-4605-b789-d477d8a6fd14 admin admin] Calling method '>' {{(pid=111970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:46:50.312537 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: INFO nova.api.openstack.wsgi [None req-3cce1759-94a8-4605-b789-d477d8a6fd14 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 12 23:46:50.314063 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi [None req-3cce1759-94a8-4605-b789-d477d8a6fd14 admin admin] Request method failure captured: Sep 12 23:46:50.314063 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 12 23:46:50.314063 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: Accept: application/json Sep 12 23:46:50.314063 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: Accept-Encoding: gzip, deflate Sep 12 23:46:50.314063 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: Connection: keep-alive Sep 12 23:46:50.314063 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: Content-Length: 0 Sep 12 23:46:50.314063 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: Host: 10.222.0.26 Sep 12 23:46:50.314063 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: Openstack-Api-Version: compute 2.92 Sep 12 23:46:50.314063 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: Openstack-System-Scope: None Sep 12 23:46:50.314063 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: User-Agent: python-novaclient Sep 12 23:46:50.314063 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-Auth-Token: gAAAAABjH8Tpu1XEtRqADybbQl6jwJZyZFxP56iR-nvy8ZJuxdPSki66BhLp2aThi2Mvdirum1H6Dj_cYYDnWKzGNTch-mq6NEQm1FsuGotqzD0501pkI9m4zcwVZLhYzhstBYwy_XBnIv5Z6G0cafOfH4cjtpdv2g1WAweXe4qMCDwmsIHZkDQ Sep 12 23:46:50.314063 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-Domain-Id: None Sep 12 23:46:50.314063 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-Domain-Name: None Sep 12 23:46:50.314063 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-Identity-Status: Confirmed Sep 12 23:46:50.314063 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-Is-Admin-Project: True Sep 12 23:46:50.314063 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-Openstack-Nova-Api-Version: 2.92 Sep 12 23:46:50.314063 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-Project-Domain-Id: default Sep 12 23:46:50.314063 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-Project-Domain-Name: Default Sep 12 23:46:50.314063 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-Project-Id: 16141215d11e48819148a2d135301f22 Sep 12 23:46:50.314063 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-Project-Name: admin Sep 12 23:46:50.314063 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-Role: admin,member,reader Sep 12 23:46:50.314063 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-Roles: admin,member,reader Sep 12 23:46:50.315533 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16141215d11e48819148a2d135301f22"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16141215d11e48819148a2d135301f22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_16141215d11e48819148a2d135301f22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/16141215d11e48819148a2d135301f22"}]}] Sep 12 23:46:50.315533 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-Tenant: admin Sep 12 23:46:50.315533 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-Tenant-Id: 16141215d11e48819148a2d135301f22 Sep 12 23:46:50.315533 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-Tenant-Name: admin Sep 12 23:46:50.315533 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-User: admin Sep 12 23:46:50.315533 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-User-Domain-Id: default Sep 12 23:46:50.315533 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-User-Domain-Name: Default Sep 12 23:46:50.315533 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-User-Id: f9f809fdc6b04f0ca4d4c2bc46e0a712 Sep 12 23:46:50.315533 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: X-User-Name: admin Sep 12 23:46:50.315533 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: method: > Sep 12 23:46:50.315533 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: exception: Flavor 451 could not be found. Sep 12 23:46:50.315533 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: action_args: {'id': '451'} Sep 12 23:46:50.315533 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: {{(pid=111970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:46:50.315533 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:46:50.316308 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 12 23:46:50.316308 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 12 23:46:50.316308 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 12 23:46:50.316308 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 12 23:46:50.316308 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 12 23:46:50.316308 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 12 23:46:50.316308 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 12 23:46:50.316308 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 12 23:46:50.316308 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 12 23:46:50.316308 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:46:50.316308 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 12 23:46:50.316308 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 12 23:46:50.316308 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 12 23:46:50.316308 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi Sep 12 23:46:50.316308 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:46:50.316308 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi Sep 12 23:46:50.316308 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:46:50.316308 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:46:50.316308 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:46:50.317580 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:46:50.317580 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:46:50.317580 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:46:50.317580 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:46:50.317580 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 12 23:46:50.317580 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:46:50.317580 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 12 23:46:50.317580 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi Sep 12 23:46:50.317580 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:46:50.317580 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi Sep 12 23:46:50.317580 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:46:50.317580 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:46:50.317580 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:46:50.317580 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:46:50.317580 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:46:50.317580 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 12 23:46:50.317580 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: ERROR nova.api.openstack.wsgi Sep 12 23:46:50.317580 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi [None req-3cce1759-94a8-4605-b789-d477d8a6fd14 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=111970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:46:50.318767 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: INFO nova.api.openstack.requestlog [None req-3cce1759-94a8-4605-b789-d477d8a6fd14 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012315 Sep 12 23:46:50.318767 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: [pid: 111970|app: 0|req: 26/52] 10.222.0.26 () {60 vars in 1193 bytes} [Mon Sep 12 23:46:50 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 12 23:46:51.580416 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi [None req-13c6e784-c9d7-4647-9af0-70aa68c46648 admin admin] Calling method '>' {{(pid=111969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:46:51.581423 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: INFO nova.api.openstack.requestlog [None req-13c6e784-c9d7-4647-9af0-70aa68c46648 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Sep 12 23:46:51.581818 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: [pid: 111969|app: 0|req: 27/53] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Sep 12 23:46:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:46:52.141245 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi [None req-a75f9d5f-d809-44fb-93bf-351d732541ab admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:46:52.163370 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: INFO nova.api.openstack.requestlog [None req-a75f9d5f-d809-44fb-93bf-351d732541ab admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.441643 Sep 12 23:46:52.163940 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: [pid: 111970|app: 0|req: 27/54] 10.222.0.26 () {64 vars in 1235 bytes} [Mon Sep 12 23:46:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 23:46:53.416262 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi [None req-13c6e784-c9d7-4647-9af0-70aa68c46648 admin admin] Calling method '>' {{(pid=111969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:46:53.417291 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: INFO nova.api.openstack.requestlog [None req-13c6e784-c9d7-4647-9af0-70aa68c46648 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Sep 12 23:46:53.417675 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: [pid: 111969|app: 0|req: 28/55] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Sep 12 23:46:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:46:53.970665 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi [None req-1f68915d-16dd-4973-80ab-e04a3ee35a8a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:46:53.990822 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: INFO nova.api.openstack.requestlog [None req-1f68915d-16dd-4973-80ab-e04a3ee35a8a admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.437660 Sep 12 23:46:53.991418 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: [pid: 111970|app: 0|req: 28/56] 10.222.0.26 () {64 vars in 1235 bytes} [Mon Sep 12 23:46:53 2022] POST /compute/v2.1/flavors => generated 405 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 23:46:55.230901 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi [None req-13c6e784-c9d7-4647-9af0-70aa68c46648 admin admin] Calling method '>' {{(pid=111969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:46:55.231954 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: INFO nova.api.openstack.requestlog [None req-13c6e784-c9d7-4647-9af0-70aa68c46648 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Sep 12 23:46:55.232357 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: [pid: 111969|app: 0|req: 29/57] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Sep 12 23:46:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:46:55.795426 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi [None req-1eeaa7b1-1dcc-4255-a0d1-eecf6e29d1b5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:46:55.815773 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: INFO nova.api.openstack.requestlog [None req-1eeaa7b1-1dcc-4255-a0d1-eecf6e29d1b5 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.445000 Sep 12 23:46:55.816308 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: [pid: 111970|app: 0|req: 29/58] 10.222.0.26 () {64 vars in 1235 bytes} [Mon Sep 12 23:46:55 2022] POST /compute/v2.1/flavors => generated 407 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 23:46:57.059856 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi [None req-13c6e784-c9d7-4647-9af0-70aa68c46648 admin admin] Calling method '>' {{(pid=111969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:46:57.060879 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: INFO nova.api.openstack.requestlog [None req-13c6e784-c9d7-4647-9af0-70aa68c46648 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Sep 12 23:46:57.061277 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: [pid: 111969|app: 0|req: 30/59] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Sep 12 23:46:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:46:57.617879 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi [None req-5eb867ba-a0c8-4063-8160-79429e4781e7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=111970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:46:57.639447 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: INFO nova.api.openstack.requestlog [None req-5eb867ba-a0c8-4063-8160-79429e4781e7 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.441365 Sep 12 23:46:57.640009 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: [pid: 111970|app: 0|req: 30/60] 10.222.0.26 () {64 vars in 1235 bytes} [Mon Sep 12 23:46:57 2022] POST /compute/v2.1/flavors => generated 409 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 23:46:58.890249 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi [None req-13c6e784-c9d7-4647-9af0-70aa68c46648 admin admin] Calling method '>' {{(pid=111969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:46:58.891249 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: INFO nova.api.openstack.requestlog [None req-13c6e784-c9d7-4647-9af0-70aa68c46648 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Sep 12 23:46:58.891678 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: [pid: 111969|app: 0|req: 31/61] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Sep 12 23:46:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:46:59.447832 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi [None req-e1901ee6-e168-4a42-94d3-c78871a04fae admin admin] Calling method '>' {{(pid=111970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:46:59.468584 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: INFO nova.api.openstack.requestlog [None req-e1901ee6-e168-4a42-94d3-c78871a04fae admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.442328 Sep 12 23:46:59.469040 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: [pid: 111970|app: 0|req: 31/62] 10.222.0.26 () {60 vars in 1202 bytes} [Mon Sep 12 23:46:59 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:47:56.780996 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi [None req-13c6e784-c9d7-4647-9af0-70aa68c46648 admin admin] Calling method '>' {{(pid=111969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:47:56.781919 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: INFO nova.api.openstack.requestlog [None req-13c6e784-c9d7-4647-9af0-70aa68c46648 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Sep 12 23:47:56.782322 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: [pid: 111969|app: 0|req: 32/63] 10.222.0.26 () {54 vars in 931 bytes} [Mon Sep 12 23:47:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:47:56.793629 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG dbcounter [-] [111970] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=111970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:47:57.199822 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi [None req-0dcb4c34-335d-4a75-8c0f-5c075d4e2da7 admin admin] Calling method '>' {{(pid=111970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:47:57.226038 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: INFO nova.api.openstack.requestlog [None req-0dcb4c34-335d-4a75-8c0f-5c075d4e2da7 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.437319 Sep 12 23:47:57.226609 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: [pid: 111970|app: 0|req: 32/64] 10.222.0.26 () {60 vars in 1292 bytes} [Mon Sep 12 23:47:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:47:57.247840 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG dbcounter [-] [111969] Writing DB stats nova_api:SELECT=14 {{(pid=111969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:47:57.251999 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi [None req-df10074a-b627-47e8-bd81-ef1ce8b97a69 admin admin] Calling method '>' {{(pid=111969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:47:57.259733 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: INFO nova.api.openstack.requestlog [None req-df10074a-b627-47e8-bd81-ef1ce8b97a69 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013303 Sep 12 23:47:57.260280 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: [pid: 111969|app: 0|req: 33/65] 10.222.0.26 () {60 vars in 1283 bytes} [Mon Sep 12 23:47:57 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:47:57.272454 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi [None req-6fde9c44-fc8d-438e-8980-73fd68c1640e admin admin] Calling method '>' {{(pid=111970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:47:57.280325 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: INFO nova.api.openstack.requestlog [None req-6fde9c44-fc8d-438e-8980-73fd68c1640e admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011316 Sep 12 23:47:57.280758 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: [pid: 111970|app: 0|req: 33/66] 10.222.0.26 () {60 vars in 1286 bytes} [Mon Sep 12 23:47:57 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:47:57.294002 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi [None req-fa847f8a-9362-462f-9ec5-56dab96a4f74 admin admin] Calling method '>' {{(pid=111969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:47:57.301405 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: INFO nova.api.openstack.requestlog [None req-fa847f8a-9362-462f-9ec5-56dab96a4f74 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011235 Sep 12 23:47:57.301964 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: [pid: 111969|app: 0|req: 34/67] 10.222.0.26 () {60 vars in 1286 bytes} [Mon Sep 12 23:47:57 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:47:57.314668 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi [None req-54da7aeb-61fa-454f-943f-2c4264fd4b2c admin admin] Calling method '>' {{(pid=111970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:47:57.322614 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: INFO nova.api.openstack.requestlog [None req-54da7aeb-61fa-454f-943f-2c4264fd4b2c admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011787 Sep 12 23:47:57.323143 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: [pid: 111970|app: 0|req: 34/68] 10.222.0.26 () {60 vars in 1283 bytes} [Mon Sep 12 23:47:57 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:50:58.383651 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi [None req-fa847f8a-9362-462f-9ec5-56dab96a4f74 admin admin] Calling method '>' {{(pid=111969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:50:58.384671 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: INFO nova.api.openstack.requestlog [None req-fa847f8a-9362-462f-9ec5-56dab96a4f74 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001557 Sep 12 23:50:58.385060 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: [pid: 111969|app: 0|req: 35/69] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Sep 12 23:50:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:50:58.525394 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG dbcounter [-] [111970] Writing DB stats nova_api:SELECT=6 {{(pid=111970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:50:58.708933 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi [None req-addc1711-5b9c-4a10-9371-db70f0455395 admin admin] Calling method '>' {{(pid=111970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:50:58.715551 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG oslo_concurrency.lockutils [None req-addc1711-5b9c-4a10-9371-db70f0455395 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:50:58.716216 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG oslo_concurrency.lockutils [None req-addc1711-5b9c-4a10-9371-db70f0455395 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:50:58.716778 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG oslo_concurrency.lockutils [None req-addc1711-5b9c-4a10-9371-db70f0455395 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=111970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:50:58.717611 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG oslo_concurrency.lockutils [None req-addc1711-5b9c-4a10-9371-db70f0455395 admin admin] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:50:58.718238 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG oslo_concurrency.lockutils [None req-addc1711-5b9c-4a10-9371-db70f0455395 admin admin] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:50:58.718665 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG oslo_concurrency.lockutils [None req-addc1711-5b9c-4a10-9371-db70f0455395 admin admin] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=111970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:50:58.752574 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: INFO nova.api.openstack.requestlog [None req-addc1711-5b9c-4a10-9371-db70f0455395 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.228230 Sep 12 23:50:58.753158 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: [pid: 111970|app: 0|req: 35/70] 10.222.0.26 () {60 vars in 1193 bytes} [Mon Sep 12 23:50:58 2022] GET /compute/v2.1/os-services => generated 794 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 23:50:59.871815 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi [None req-fa847f8a-9362-462f-9ec5-56dab96a4f74 admin admin] Calling method '>' {{(pid=111969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:50:59.872823 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: INFO nova.api.openstack.requestlog [None req-fa847f8a-9362-462f-9ec5-56dab96a4f74 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Sep 12 23:50:59.873221 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: [pid: 111969|app: 0|req: 36/71] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Sep 12 23:50:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:51:00.069829 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi [None req-ba7b3f81-8f8a-42f3-93b9-945a0811a663 admin admin] Calling method '>' {{(pid=111970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:51:00.073435 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG oslo_concurrency.lockutils [None req-ba7b3f81-8f8a-42f3-93b9-945a0811a663 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:51:00.074087 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG oslo_concurrency.lockutils [None req-ba7b3f81-8f8a-42f3-93b9-945a0811a663 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:51:00.074535 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG oslo_concurrency.lockutils [None req-ba7b3f81-8f8a-42f3-93b9-945a0811a663 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:51:00.075251 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG oslo_concurrency.lockutils [None req-ba7b3f81-8f8a-42f3-93b9-945a0811a663 admin admin] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:51:00.075969 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG oslo_concurrency.lockutils [None req-ba7b3f81-8f8a-42f3-93b9-945a0811a663 admin admin] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:51:00.076293 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG oslo_concurrency.lockutils [None req-ba7b3f81-8f8a-42f3-93b9-945a0811a663 admin admin] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:51:00.096012 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: INFO nova.api.openstack.requestlog [None req-ba7b3f81-8f8a-42f3-93b9-945a0811a663 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.081856 Sep 12 23:51:00.096577 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: [pid: 111970|app: 0|req: 36/72] 10.222.0.26 () {60 vars in 1193 bytes} [Mon Sep 12 23:51:00 2022] GET /compute/v2.1/os-services => generated 794 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 23:51:11.651508 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi [None req-fa847f8a-9362-462f-9ec5-56dab96a4f74 admin admin] Calling method '>' {{(pid=111969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:51:11.652772 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: INFO nova.api.openstack.requestlog [None req-fa847f8a-9362-462f-9ec5-56dab96a4f74 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001817 Sep 12 23:51:11.653343 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: [pid: 111969|app: 0|req: 37/73] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Sep 12 23:51:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 23:51:11.800429 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG dbcounter [-] [111970] Writing DB stats nova_cell0:SELECT=4 {{(pid=111970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:51:11.801193 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG dbcounter [-] [111970] Writing DB stats nova_cell1:SELECT=4 {{(pid=111970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:51:11.801848 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG dbcounter [-] [111970] Writing DB stats nova_api:SELECT=8 {{(pid=111970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:51:11.852584 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi [None req-23c7fc5a-8659-4ce8-8e7e-6fb9f348294b admin admin] Calling method '>' {{(pid=111970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:51:11.856113 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG oslo_concurrency.lockutils [None req-23c7fc5a-8659-4ce8-8e7e-6fb9f348294b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:51:11.856528 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG oslo_concurrency.lockutils [None req-23c7fc5a-8659-4ce8-8e7e-6fb9f348294b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:51:11.856952 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG oslo_concurrency.lockutils [None req-23c7fc5a-8659-4ce8-8e7e-6fb9f348294b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:51:11.857661 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG oslo_concurrency.lockutils [None req-23c7fc5a-8659-4ce8-8e7e-6fb9f348294b admin admin] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:51:11.858114 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG oslo_concurrency.lockutils [None req-23c7fc5a-8659-4ce8-8e7e-6fb9f348294b admin admin] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:51:11.858516 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG oslo_concurrency.lockutils [None req-23c7fc5a-8659-4ce8-8e7e-6fb9f348294b admin admin] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:51:11.885212 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: INFO nova.api.openstack.requestlog [None req-23c7fc5a-8659-4ce8-8e7e-6fb9f348294b admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.92 time: 0.089271 Sep 12 23:51:11.885805 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: [pid: 111970|app: 0|req: 37/74] 10.222.0.26 () {60 vars in 1193 bytes} [Mon Sep 12 23:51:11 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:51:12.973641 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG nova.api.openstack.wsgi [None req-fa847f8a-9362-462f-9ec5-56dab96a4f74 admin admin] Calling method '>' {{(pid=111969) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:51:12.974670 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: INFO nova.api.openstack.requestlog [None req-fa847f8a-9362-462f-9ec5-56dab96a4f74 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Sep 12 23:51:12.975173 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: [pid: 111969|app: 0|req: 38/75] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Sep 12 23:51:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:51:13.170418 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG nova.api.openstack.wsgi [None req-75c19460-171a-43f8-82e6-ecf233828206 admin admin] Calling method '>' {{(pid=111970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:51:13.174062 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG oslo_concurrency.lockutils [None req-75c19460-171a-43f8-82e6-ecf233828206 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:51:13.174574 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG oslo_concurrency.lockutils [None req-75c19460-171a-43f8-82e6-ecf233828206 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=111970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:51:13.175003 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG oslo_concurrency.lockutils [None req-75c19460-171a-43f8-82e6-ecf233828206 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:51:13.175867 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG oslo_concurrency.lockutils [None req-75c19460-171a-43f8-82e6-ecf233828206 admin admin] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=111970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:51:13.176310 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG oslo_concurrency.lockutils [None req-75c19460-171a-43f8-82e6-ecf233828206 admin admin] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=111970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:51:13.176719 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: DEBUG oslo_concurrency.lockutils [None req-75c19460-171a-43f8-82e6-ecf233828206 admin admin] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=111970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:51:13.199419 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: INFO nova.api.openstack.requestlog [None req-75c19460-171a-43f8-82e6-ecf233828206 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.92 time: 0.085461 Sep 12 23:51:13.199908 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: [pid: 111970|app: 0|req: 38/76] 10.222.0.26 () {60 vars in 1193 bytes} [Mon Sep 12 23:51:13 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:52:13.174794 dv-cinder-820027-26-iscsi devstack@n-api.service[111968]: Mon Sep 12 23:52:13 2022 - graceful shutdown triggered... Sep 12 23:52:13.175368 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: Gracefully killing worker 1 (pid: 111969)... Sep 12 23:52:13.177565 dv-cinder-820027-26-iscsi devstack@n-api.service[111970]: Gracefully killing worker 2 (pid: 111970)... Sep 12 23:52:13.178159 dv-cinder-820027-26-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 12 23:52:13.307796 dv-cinder-820027-26-iscsi devstack@n-api.service[111969]: DEBUG dbcounter [-] [111969] Writing DB stats nova_api:SELECT=4 {{(pid=111969) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:52:14.176024 dv-cinder-820027-26-iscsi devstack@n-api.service[111968]: worker 1 buried after 1 seconds Sep 12 23:52:14.176024 dv-cinder-820027-26-iscsi devstack@n-api.service[111968]: worker 2 buried after 1 seconds Sep 12 23:52:14.176024 dv-cinder-820027-26-iscsi devstack@n-api.service[111968]: goodbye to uWSGI. Sep 12 23:52:14.177784 dv-cinder-820027-26-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 12 23:52:14.178348 dv-cinder-820027-26-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 12 23:52:14.181541 dv-cinder-820027-26-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 12 23:52:14.195955 dv-cinder-820027-26-iscsi devstack@n-api.service[126962]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 12 23:52:14.198106 dv-cinder-820027-26-iscsi devstack@n-api.service[126962]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 12 23:52:14 2022] *** Sep 12 23:52:14.198106 dv-cinder-820027-26-iscsi devstack@n-api.service[126962]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 12 23:52:14.198106 dv-cinder-820027-26-iscsi devstack@n-api.service[126962]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 12 23:52:14.198106 dv-cinder-820027-26-iscsi devstack@n-api.service[126962]: nodename: dv-cinder-820027-26-iscsi Sep 12 23:52:14.198106 dv-cinder-820027-26-iscsi devstack@n-api.service[126962]: machine: x86_64 Sep 12 23:52:14.198106 dv-cinder-820027-26-iscsi devstack@n-api.service[126962]: clock source: unix Sep 12 23:52:14.198106 dv-cinder-820027-26-iscsi devstack@n-api.service[126962]: pcre jit disabled Sep 12 23:52:14.198106 dv-cinder-820027-26-iscsi devstack@n-api.service[126962]: detected number of CPU cores: 4 Sep 12 23:52:14.198106 dv-cinder-820027-26-iscsi devstack@n-api.service[126962]: current working directory: / Sep 12 23:52:14.198106 dv-cinder-820027-26-iscsi devstack@n-api.service[126962]: detected binary path: /usr/bin/uwsgi-core Sep 12 23:52:14.198106 dv-cinder-820027-26-iscsi devstack@n-api.service[126962]: your processes number limit is 47680 Sep 12 23:52:14.198106 dv-cinder-820027-26-iscsi devstack@n-api.service[126962]: your memory page size is 4096 bytes Sep 12 23:52:14.198106 dv-cinder-820027-26-iscsi devstack@n-api.service[126962]: detected max file descriptor number: 2048 Sep 12 23:52:14.198106 dv-cinder-820027-26-iscsi devstack@n-api.service[126962]: lock engine: pthread robust mutexes Sep 12 23:52:14.199031 dv-cinder-820027-26-iscsi devstack@n-api.service[126962]: thunder lock: enabled Sep 12 23:52:14.199031 dv-cinder-820027-26-iscsi devstack@n-api.service[126962]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 12 23:52:14.199031 dv-cinder-820027-26-iscsi devstack@n-api.service[126962]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 12 23:52:14.241224 dv-cinder-820027-26-iscsi devstack@n-api.service[126962]: Python main interpreter initialized at 0x5584430a19c0 Sep 12 23:52:14.241224 dv-cinder-820027-26-iscsi devstack@n-api.service[126962]: python threads support enabled Sep 12 23:52:14.241224 dv-cinder-820027-26-iscsi devstack@n-api.service[126962]: your server socket listen backlog is limited to 100 connections Sep 12 23:52:14.241224 dv-cinder-820027-26-iscsi devstack@n-api.service[126962]: your mercy for graceful operations on workers is 90 seconds Sep 12 23:52:14.241712 dv-cinder-820027-26-iscsi devstack@n-api.service[126962]: mapped 403077 bytes (393 KB) for 2 cores Sep 12 23:52:14.241712 dv-cinder-820027-26-iscsi devstack@n-api.service[126962]: *** Operational MODE: preforking *** Sep 12 23:52:14.242048 dv-cinder-820027-26-iscsi devstack@n-api.service[126962]: *** uWSGI is running in multiple interpreter mode *** Sep 12 23:52:14.242048 dv-cinder-820027-26-iscsi devstack@n-api.service[126962]: spawned uWSGI master process (pid: 126962) Sep 12 23:52:14.242319 dv-cinder-820027-26-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 12 23:52:14.242853 dv-cinder-820027-26-iscsi devstack@n-api.service[126962]: spawned uWSGI worker 1 (pid: 126975, cores: 1) Sep 12 23:52:14.243553 dv-cinder-820027-26-iscsi devstack@n-api.service[126962]: spawned uWSGI worker 2 (pid: 126976, cores: 1) Sep 12 23:52:14.243553 dv-cinder-820027-26-iscsi devstack@n-api.service[126962]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 12 23:52:14.900482 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 12 23:52:14.905205 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 12 23:52:16.067920 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 12 23:52:16.067920 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: from cryptography.utils import int_from_bytes Sep 12 23:52:16.068758 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 12 23:52:16.068758 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: from cryptography.utils import int_from_bytes Sep 12 23:52:16.083639 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 12 23:52:16.083639 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: from cryptography.utils import int_from_bytes Sep 12 23:52:16.084300 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 12 23:52:16.084300 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: from cryptography.utils import int_from_bytes Sep 12 23:52:18.507381 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 12 23:52:18.508262 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 12 23:52:18.508262 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 12 23:52:18.508571 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 12 23:52:18.508807 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 12 23:52:18.509203 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.509570 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.509865 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.510157 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.510514 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.510850 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.511146 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.511495 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.511806 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.512742 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.512742 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.512943 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-26-iscsi {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.516972 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.516972 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.516972 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.516972 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.516972 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.516972 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.516972 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.517539 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.517539 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.517539 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.517539 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.517539 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.517539 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.517946 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.517946 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.518466 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.518466 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.518761 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.519153 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-26-iscsi {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.519508 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.519848 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.520167 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.520579 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.520893 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.521200 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.521509 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.521845 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.522151 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.522475 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.522783 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.523173 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.523603 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.523909 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.524382 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.524630 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.524963 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.525272 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.525580 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.525828 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.526142 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.526467 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.526785 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.527105 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.527365 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.527613 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.527940 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.528312 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.528889 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.528889 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.529540 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.529540 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.530121 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.530121 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.530833 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.530833 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.531331 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.531331 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.531785 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.532092 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.532402 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.532631 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.533426 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.533903 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.533903 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.534416 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.534903 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.534903 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.535346 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.535537 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.535686 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.536001 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.536335 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.536674 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.536980 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.537231 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.537536 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.537930 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.538134 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.538448 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.538780 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.539104 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.539432 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.539741 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.540061 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.540368 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.540665 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.540980 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.541284 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.541592 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.541896 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.542204 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.542513 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.542823 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.543146 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.543464 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.543797 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.544086 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.544393 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.544708 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.545087 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.545314 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.545637 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.545949 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.546255 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.546583 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.546887 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.547191 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.547553 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.547840 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.548149 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.548515 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.548755 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.549049 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.549351 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.549656 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.549972 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.550277 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.551330 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.551573 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.551875 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.552201 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.552525 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.552818 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.553138 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.553441 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.553763 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.554108 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.554547 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.554882 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.555289 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.555570 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.555906 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.556225 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.556535 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.556851 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.557179 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.557490 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.557803 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.558116 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.558438 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.558753 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.559129 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.559441 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.559678 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 12 23:52:18.560466 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.560632 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 12 23:52:18.560798 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.560798 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.561135 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 12 23:52:18.561290 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.561475 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 12 23:52:18.561716 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.561872 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 12 23:52:18.562029 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.562179 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.562447 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.562608 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.562760 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.563013 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.563168 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.563349 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.563524 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.563678 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.563881 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.564057 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.564287 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.564463 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.564616 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.564766 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.564922 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.565115 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.565115 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.565562 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.565723 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.565867 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.565867 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.566146 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-26-iscsi {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.566290 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.566442 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.566604 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.566756 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.566906 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.567058 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.567231 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.567398 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.567562 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.567762 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.567911 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.568062 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.568215 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.568357 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.568517 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.568660 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.568930 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.569088 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.569331 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.569488 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.569632 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.569783 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.569943 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.570106 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.570251 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.570411 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.570591 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.570743 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.570886 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.571082 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.571285 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.571435 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.571600 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.571755 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.571899 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.572058 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.572209 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.572360 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-26-iscsi {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.572528 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.572681 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.572840 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.573003 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.573231 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.573389 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.573546 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.573546 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.573931 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.574107 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.574278 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.574499 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.574646 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.574646 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.574962 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.575113 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.575332 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.575511 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.575758 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.575918 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.576062 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.576214 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.576365 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.576517 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.576672 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.576957 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.577127 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.577285 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.577435 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.577586 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.577740 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.577938 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.578086 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.578235 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.578396 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.578569 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.578725 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.578886 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.579119 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.579312 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.579553 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.579720 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.579893 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.580043 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.580195 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.580374 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.580602 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.580834 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.581069 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.581311 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.581480 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.581880 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.582034 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.582189 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.582334 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.582493 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.582493 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.582787 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.582951 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.583095 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.583297 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.583540 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.583704 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.583858 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.584069 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.584244 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.584397 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.584632 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.584787 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.584930 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.585108 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.585262 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.585456 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.585665 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.585818 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.586084 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.586243 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.586396 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.586547 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.586740 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.586948 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.587112 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.587288 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.587452 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.587618 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.587772 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.587971 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.588129 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.588298 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.588454 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.588604 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.588749 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.588891 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.589096 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.589317 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.589475 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.589707 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.589876 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.590172 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.590330 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.590488 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.590653 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.590798 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.590943 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.591085 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.591285 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.591541 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.591716 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.591864 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.592065 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.592245 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.592391 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.592543 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.592707 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.592852 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.593055 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.593225 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.593225 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.593534 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.593758 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.593904 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.594056 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.594248 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.594411 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.594563 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.594825 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.595048 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.595301 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.595523 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.595764 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.595916 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.596077 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.596346 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.596504 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.596655 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.596809 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.596952 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.597103 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.597248 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.597435 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.597582 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.597735 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.597900 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.598099 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.598272 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.598461 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.598617 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.598769 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.598913 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.599063 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.599214 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.599487 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.599696 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.599919 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.600075 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.600257 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.600407 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.600551 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.600694 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.600895 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.601147 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.602068 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.602228 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.602382 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.602382 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.602692 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.602837 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.603001 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.603153 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.603374 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.603566 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.603797 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.604057 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.604217 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.604417 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.604580 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.604746 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.605013 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.605184 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.605337 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.605489 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.605642 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.605879 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.606050 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.606210 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.606382 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.606655 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.606813 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.606957 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.607100 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.607287 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.607446 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.607626 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.607782 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.607925 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.608126 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.608291 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.608453 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.608597 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.608741 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.608885 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.609115 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.609307 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.609485 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.609729 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.609878 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.610136 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.610303 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.610449 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.610593 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.610756 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 12 23:52:18.610918 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.611061 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.611255 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.611407 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.611583 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.611744 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.611896 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.612050 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.612203 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.612347 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.612492 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.612645 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.612797 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.612956 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.613109 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.613330 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.613498 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.613701 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.613851 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.614056 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.614337 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.614529 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.614712 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.614864 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.615026 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.615310 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.615462 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.615624 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.615769 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.615924 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.616144 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.616302 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.616468 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.616623 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.616999 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.617149 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.617309 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.617461 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.617605 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.617796 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.617941 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.618084 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.618369 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.618533 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.618689 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.618834 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.618985 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.619128 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.619358 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.619526 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.619675 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.619944 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.620092 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.620358 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.620520 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.620672 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.620835 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.620979 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.621129 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.621283 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.621435 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.621640 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.621810 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.621954 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.622104 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.622262 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.622414 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.622557 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.622720 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.622864 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.623007 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.623160 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.623338 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.623531 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.623740 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.623897 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.624041 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.624281 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.624595 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.624801 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.624959 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.625116 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.625324 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.625697 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.625697 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.626130 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.626629 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.626848 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.627073 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.627441 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.627625 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.627773 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.627928 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.628082 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.628326 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.628493 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.628670 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.628818 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.628975 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.629127 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.629290 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.629449 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.629594 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.629853 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.630116 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.630266 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.630540 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.630725 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.630899 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.631100 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.631285 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.631443 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.631601 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.631803 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.631966 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.632125 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.632278 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.632480 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.632648 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.632839 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.632988 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.633142 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.633295 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.633439 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.633589 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.633775 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.633940 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.634092 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.634243 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.634387 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.634565 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.634877 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.635081 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.635270 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.635433 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.635623 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.635882 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.636043 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.636202 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.636384 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.636567 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.636745 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.636897 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.637059 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.637218 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.637374 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.637655 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.637814 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.638036 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.638193 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.638346 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.638551 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.638727 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.638876 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.639028 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.639187 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.639355 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.639503 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.639723 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.639884 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.640049 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.640309 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.640459 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.640704 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.640860 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.641044 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.641253 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.641408 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.641408 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.641695 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.641888 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.642077 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.642246 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.642399 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.642543 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.642687 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.642864 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.643018 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.643177 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.643373 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.643539 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.643704 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.643863 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.644026 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.644205 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.644362 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.644520 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.644671 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.644855 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.645171 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.645341 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.645503 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.645662 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.645870 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.646122 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.646295 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.646468 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.646683 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.646842 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.647022 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.647181 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.647375 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.647566 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.647867 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.648103 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.648281 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.648487 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.648661 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.648813 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.648986 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.649145 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.649304 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.649462 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.649630 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.649783 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.649933 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.650100 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.650282 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.650548 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.650725 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.650997 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.653849 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.654041 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.654200 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.654422 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.654579 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.654739 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.654894 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.655070 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.655445 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.655648 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.655811 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.655974 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.656142 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.656446 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.656622 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.656847 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.657014 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.657166 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.657316 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.657474 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.657635 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.657786 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.658452 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.658663 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.658818 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.658978 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.659159 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.659336 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.659487 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.659653 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.659822 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.659974 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.660134 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.660285 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.660433 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.660723 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.660879 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.661161 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.661161 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.661635 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.661635 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.662080 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.662317 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.662617 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.662782 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.662942 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.663148 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.663546 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.663848 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.664152 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.664318 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.664471 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.664644 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.664812 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.664972 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.665133 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.665290 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.665663 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.665876 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.666030 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.666195 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.666357 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.666637 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.666801 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.667029 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.667194 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.667415 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.667595 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.667749 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.667907 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.668066 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.668219 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.668379 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.668755 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.668914 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.669074 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.669234 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.669408 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.669571 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.669730 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.669888 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.670663 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.670951 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.671127 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.671462 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.671688 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.671847 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.671999 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.672149 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.672310 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.672514 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.672699 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.672859 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.673018 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.673168 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.673402 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.673555 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.673708 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.673858 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.674015 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.674166 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.674330 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.674488 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.674666 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.674828 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.674986 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.675145 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.675334 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.675498 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.683636 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.684628 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.684832 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.685020 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.685240 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.685423 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.685591 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.685812 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.685996 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.686149 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.686302 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.686453 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.686604 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.686796 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.687033 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.687638 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.687804 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.687970 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.688121 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.688282 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.688445 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.688606 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.688771 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.688972 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.689287 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.689513 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.689677 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.689830 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.689989 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.690149 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.690336 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.690498 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.690649 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.690798 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.690957 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.691116 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.691390 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.693147 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.693340 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.693553 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.693769 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.693976 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.694147 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.694322 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.694476 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.694627 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.694627 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.694978 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.695137 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.695308 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.695478 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.695742 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.695930 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.696137 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.696387 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.696644 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.696880 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.697042 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.697202 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.697387 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.697693 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.697864 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.698025 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.698177 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.698337 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.698537 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.698772 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.699022 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.699022 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.699372 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.699926 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.700089 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.700248 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.700413 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.701148 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.701323 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.701492 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.701673 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.701856 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.702020 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.702020 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.702436 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.702598 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.703258 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.703437 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.703685 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.703923 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.704082 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.704295 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.705558 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.705822 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.706099 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.706301 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.706504 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.706749 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.706926 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.707209 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.707412 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.707684 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.707868 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.709242 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.709437 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.709629 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.709804 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.709959 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.710119 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.710294 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.710482 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.710708 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.710930 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.711174 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.711488 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.711772 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.712020 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.712278 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.712526 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.712734 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.712734 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.713203 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.713391 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.713562 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.713722 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.713933 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.717174 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.717383 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.717549 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.717743 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.717978 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.718191 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.718333 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.718457 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.718587 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.718701 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.718820 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.718941 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.719060 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.719398 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.719875 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.720046 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.720208 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.720368 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.720520 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.720677 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.720845 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.721016 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.721176 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.721328 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.721485 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.721671 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.721838 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.722072 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.722230 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.722390 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.722541 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.722732 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.722961 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.723200 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.723475 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.723692 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.723861 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.724099 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.724364 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.724572 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.724735 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.724885 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.725050 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.725050 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.725368 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.725520 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.725677 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.725677 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.725677 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.725677 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.726378 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.726589 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.726747 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.726747 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.726747 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.726747 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.726747 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.726747 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.726747 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.726747 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.728110 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.728110 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.728110 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.728110 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.728110 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.728110 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.728110 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.728110 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.729404 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.729582 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.729834 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.729992 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.729992 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.730470 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.730880 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.731049 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.731211 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.731211 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.731897 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.732056 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.732215 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.732368 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.732529 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.732696 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.732848 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.733009 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.733189 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.733393 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.733558 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.733722 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.733874 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.734024 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.734024 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.734310 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.734487 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.734735 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.734959 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.735179 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.736194 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.737066 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.737245 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.737400 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.737552 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.737552 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.737852 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.738002 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.738002 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.738447 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.738614 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.738614 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.738957 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.739119 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.739119 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.739119 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.739119 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.739119 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.740229 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.740500 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.740500 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.741054 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.741294 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.741520 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.741880 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.742414 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.742669 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.742901 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.743133 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.743410 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.743654 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.743654 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.744096 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.744336 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.744573 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.744824 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.745081 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.745350 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.745600 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.745842 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.746089 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.746332 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.746599 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.746823 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.747048 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.747291 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.747584 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.747818 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.748062 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.748574 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.748574 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.748894 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.749048 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.749199 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.749349 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.749567 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.749726 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.749877 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.750028 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.750324 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.750505 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.750827 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.751386 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.751386 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.751725 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.751920 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.752093 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.752271 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.752829 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.752989 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.753174 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.753945 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.753945 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.754197 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.754296 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.754296 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.754441 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.754512 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.754677 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.754777 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.754865 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.754956 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.755036 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.755108 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.755201 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.755316 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.755404 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.755494 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.755494 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.755664 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.755664 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.755832 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.755916 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.756007 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.756100 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.756193 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.756193 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.756193 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.756413 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.756495 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.756577 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.756674 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.756759 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.756842 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.756925 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.757009 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.757099 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.757198 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.757358 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.757492 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.757622 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.757753 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.757853 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.757940 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.758024 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.758116 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.758116 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.758327 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.758465 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.758554 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.758554 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.758714 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.758714 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.758873 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.758965 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.759059 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.759140 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.759239 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.759327 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.759425 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.759511 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.759657 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.759751 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.759843 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.759943 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.759943 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.760109 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.760200 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.760284 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.760435 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.760435 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.760657 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.760751 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.760751 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.760952 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.761041 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.761124 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.761216 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.761302 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.761419 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.761505 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.761598 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.761694 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.761794 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.761794 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.761965 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.762049 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.762128 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.762356 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.762356 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.762539 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.762624 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.762731 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.762842 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.762943 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.763037 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.763130 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.763435 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.763553 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.763652 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.763746 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.763820 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.763891 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.763961 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.763961 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.764110 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.764188 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.764188 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.764188 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.764396 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.764466 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.764545 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.764636 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.764719 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.764808 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.764900 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.764993 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.765087 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.765171 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.765242 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.765325 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.765407 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.765510 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.765597 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.765680 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.765770 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.765854 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.765925 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.766005 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.766005 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.766005 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.766005 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.766005 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.766326 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.766411 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.766411 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.766579 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.766663 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.766753 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.766899 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.767008 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.767095 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.767268 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.767372 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.767372 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.767621 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.767758 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.767937 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.768030 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.768122 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.768207 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.768308 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.768401 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.768534 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.768633 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.768719 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.768810 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.768908 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.768994 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.768994 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.768994 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.769211 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.769303 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.769401 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.769487 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.769487 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.769644 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.769801 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.769900 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.769992 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.770077 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.770169 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.770253 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.770337 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.770429 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.770515 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.770593 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.770734 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.770827 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.770957 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.770957 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.771130 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.771266 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.771345 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.771428 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.771507 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.771665 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.771761 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.771846 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.771930 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.772012 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.772093 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.772178 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.772260 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.772367 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.772460 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.772545 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.772636 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.772729 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.772815 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.772899 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.772999 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.773113 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.773210 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.773297 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.773595 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.773706 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.773706 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.773851 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.773931 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.774019 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.774111 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.774203 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.774287 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.774369 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.774441 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.774510 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.774579 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.774648 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.774724 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.774804 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.774890 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.774969 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.775059 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.775158 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.775271 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.775415 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.775541 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.775654 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.775765 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.775765 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.775987 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.776112 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.776223 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.776337 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.776469 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.776558 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.776645 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.776731 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.776822 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.776914 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.776999 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.777080 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.777161 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.777242 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.777313 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.777390 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.777468 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.777546 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.777632 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.777706 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.777706 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.777832 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.777900 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.778014 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.778096 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.778174 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.778246 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.778325 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.778396 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.778483 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.778562 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.778640 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.778712 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.779602 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.779695 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.779787 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.779861 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.779861 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.780004 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.780076 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.780157 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.780238 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.780308 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.780386 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.780458 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.780535 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.780619 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.780691 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.780768 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.780853 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.780933 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.781010 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.781095 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.781175 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.781246 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.781315 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.781384 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.781463 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.781541 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.781613 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.781613 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.781747 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.781816 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.781900 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.781978 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.782057 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.782127 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.782197 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.782266 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.782350 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.782422 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.782498 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.782576 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.782654 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.782740 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.782812 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.784476 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.784578 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.784663 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.784758 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.784855 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.784942 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.785027 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.785111 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.785203 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.785297 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.785391 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.785483 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.785575 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.785656 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.785740 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.785821 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.785908 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.785991 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.786082 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.786167 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.786250 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.786347 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.786432 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.786432 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.786572 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.786642 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.786711 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.786790 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.786889 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.786973 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.787056 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.787147 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.787387 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.787545 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.787669 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.787784 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.787876 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.787962 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.788060 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.788154 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.788248 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.788327 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.788406 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.788478 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.788587 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.788691 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.788780 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.788860 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.788941 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.789035 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.789125 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.789206 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.789298 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.789390 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.789462 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.789539 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.789620 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.789693 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.789771 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.789771 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.789919 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.790818 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.790915 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.790996 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.791081 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.791165 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.791359 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.791459 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.791459 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.791620 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.791705 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.791788 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.791871 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.791961 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.792047 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.792137 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.792220 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.792302 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.792446 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.792549 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.792635 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.792725 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.792817 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.792901 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.792986 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.793065 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.793065 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.793216 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.793309 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.793399 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.793480 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.793552 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.793641 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.793725 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.793808 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.793887 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.793981 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.794066 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.794156 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.794248 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.794339 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.794429 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.794429 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.794618 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.794713 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.794713 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.794881 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.794979 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.795066 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.795150 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.795150 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.795340 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.795428 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.795428 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.795583 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.795660 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.795751 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.795830 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.795830 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.795830 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.795830 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.795830 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.795830 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.796241 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.796334 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.796334 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.796635 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.796719 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.796803 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.796873 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.796873 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.797029 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.797121 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.797121 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.797282 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.797366 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.797462 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.797557 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.797642 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.797642 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.797794 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.797794 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.797958 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.798042 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.798125 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.798208 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.798297 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.798390 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.798484 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.798569 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.798651 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.798742 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.798815 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.798910 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.799003 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.799095 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.799187 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.799407 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.799504 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.799600 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.799600 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.799816 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.799910 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.800002 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.800096 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.800190 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.800276 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.800370 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.800504 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 12 23:52:18.800625 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.800625 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.800625 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.800625 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.800625 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.800625 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.800625 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.800625 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.801387 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.801387 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.801387 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.801387 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.801387 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.801387 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.801387 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.801387 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.801964 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.801964 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.801964 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.801964 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.801964 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.801964 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.801964 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.801964 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.802561 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.802561 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.802561 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.802561 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.802561 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.802561 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.802561 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.802561 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.803168 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.803168 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.803168 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.803168 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.803168 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.803168 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.803168 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.803168 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.803842 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.803842 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.803842 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.803842 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.803842 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.803842 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.803842 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.804389 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.804389 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.804647 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.804953 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.805262 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.805566 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.805871 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.806176 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.806478 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.806784 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.807096 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.807429 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.807732 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.808040 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.808339 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.808646 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.808944 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.809278 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.809609 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.809948 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.810251 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.810561 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.810880 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.811188 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.811541 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.811869 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.812190 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.812510 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.812834 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.813132 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.813441 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.813755 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.814065 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.814376 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.814681 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.815010 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.815357 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.815665 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.815987 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.816304 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.816622 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.816938 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.817252 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.817569 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.817877 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.818191 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.818496 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.818810 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.819110 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.819445 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.819761 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.820184 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.820508 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.820825 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.821149 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.821476 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.821783 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.822110 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.822434 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.822786 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.823095 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.823468 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.823816 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.824112 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.824425 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.824731 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 12 23:52:18.824970 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=126975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 12 23:52:18.848637 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO dbcounter [None req-8283853e-72a7-4922-a33a-46f22b31f8e2 None None] Registered counter for database nova_api Sep 12 23:52:18.870805 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_db.sqlalchemy.engines [None req-8283853e-72a7-4922-a33a-46f22b31f8e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126976) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 23:52:18.878111 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writer thread running {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 23:52:18.888037 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO dbcounter [None req-d9eca7fc-221a-4670-ae8b-719f6cba2753 None None] Registered counter for database nova_api Sep 12 23:52:18.910231 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_db.sqlalchemy.engines [None req-d9eca7fc-221a-4670-ae8b-719f6cba2753 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126975) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 23:52:18.917698 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writer thread running {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 23:52:18.935758 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.context [None req-8283853e-72a7-4922-a33a-46f22b31f8e2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f9381776-92ff-451b-9afd-34bdc816952e(cell1) {{(pid=126976) load_cells /opt/stack/nova/nova/context.py:464}} Sep 12 23:52:18.940000 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8283853e-72a7-4922-a33a-46f22b31f8e2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:52:18.940487 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8283853e-72a7-4922-a33a-46f22b31f8e2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:52:18.942099 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8283853e-72a7-4922-a33a-46f22b31f8e2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:52:18.942886 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8283853e-72a7-4922-a33a-46f22b31f8e2 None None] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:52:18.943353 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8283853e-72a7-4922-a33a-46f22b31f8e2 None None] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:52:18.945481 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8283853e-72a7-4922-a33a-46f22b31f8e2 None None] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:52:18.947585 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO dbcounter [None req-8283853e-72a7-4922-a33a-46f22b31f8e2 None None] Registered counter for database nova_cell0 Sep 12 23:52:18.951864 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO dbcounter [None req-8283853e-72a7-4922-a33a-46f22b31f8e2 None None] Registered counter for database nova_cell1 Sep 12 23:52:18.960400 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_db.sqlalchemy.engines [None req-8283853e-72a7-4922-a33a-46f22b31f8e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126976) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 23:52:18.965613 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writer thread running {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 23:52:18.966259 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_db.sqlalchemy.engines [None req-8283853e-72a7-4922-a33a-46f22b31f8e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126976) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 23:52:18.974772 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.context [None req-d9eca7fc-221a-4670-ae8b-719f6cba2753 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f9381776-92ff-451b-9afd-34bdc816952e(cell1) {{(pid=126975) load_cells /opt/stack/nova/nova/context.py:464}} Sep 12 23:52:18.979391 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d9eca7fc-221a-4670-ae8b-719f6cba2753 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:52:18.979987 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d9eca7fc-221a-4670-ae8b-719f6cba2753 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:52:18.981757 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d9eca7fc-221a-4670-ae8b-719f6cba2753 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:52:18.982625 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d9eca7fc-221a-4670-ae8b-719f6cba2753 None None] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:52:18.983138 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d9eca7fc-221a-4670-ae8b-719f6cba2753 None None] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:52:18.985309 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d9eca7fc-221a-4670-ae8b-719f6cba2753 None None] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:52:18.987496 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO dbcounter [None req-d9eca7fc-221a-4670-ae8b-719f6cba2753 None None] Registered counter for database nova_cell0 Sep 12 23:52:18.992481 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO dbcounter [None req-d9eca7fc-221a-4670-ae8b-719f6cba2753 None None] Registered counter for database nova_cell1 Sep 12 23:52:19.002279 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_db.sqlalchemy.engines [None req-d9eca7fc-221a-4670-ae8b-719f6cba2753 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126975) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 23:52:19.004074 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_db.sqlalchemy.engines [None req-d9eca7fc-221a-4670-ae8b-719f6cba2753 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126975) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 23:52:19.012368 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writer thread running {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 23:52:19.013994 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writer thread running {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 23:52:19.117301 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writer thread running {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 23:52:19.126990 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO dbcounter [None req-8283853e-72a7-4922-a33a-46f22b31f8e2 None None] Registered counter for database nova_cell0 Sep 12 23:52:19.135269 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_db.sqlalchemy.engines [None req-8283853e-72a7-4922-a33a-46f22b31f8e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126976) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 23:52:19.143343 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writer thread running {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 23:52:19.207015 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO dbcounter [None req-d9eca7fc-221a-4670-ae8b-719f6cba2753 None None] Registered counter for database nova_cell0 Sep 12 23:52:19.214488 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_db.sqlalchemy.engines [None req-d9eca7fc-221a-4670-ae8b-719f6cba2753 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=126975) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 12 23:52:19.219821 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writer thread running {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 12 23:52:19.676834 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: WARNING keystonemiddleware.auth_token [None req-8283853e-72a7-4922-a33a-46f22b31f8e2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 12 23:52:19.690043 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: WARNING keystonemiddleware.auth_token [None req-8283853e-72a7-4922-a33a-46f22b31f8e2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 12 23:52:19.724283 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: WARNING keystonemiddleware.auth_token [None req-d9eca7fc-221a-4670-ae8b-719f6cba2753 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 12 23:52:19.738222 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: WARNING keystonemiddleware.auth_token [None req-d9eca7fc-221a-4670-ae8b-719f6cba2753 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 12 23:52:20.130268 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: WARNING keystonemiddleware.auth_token [None req-8283853e-72a7-4922-a33a-46f22b31f8e2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 12 23:52:20.142337 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: WARNING keystonemiddleware.auth_token [None req-8283853e-72a7-4922-a33a-46f22b31f8e2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 12 23:52:20.148285 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: WARNING keystonemiddleware.auth_token [None req-d9eca7fc-221a-4670-ae8b-719f6cba2753 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 12 23:52:20.152723 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5584430a19c0 pid: 126976 (default app) Sep 12 23:52:20.154616 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: WARNING keystonemiddleware.auth_token [None req-d9eca7fc-221a-4670-ae8b-719f6cba2753 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 12 23:52:20.160510 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5584430a19c0 pid: 126975 (default app) Sep 12 23:52:55.842907 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=3 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:52:55.845097 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=3 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:52:55.846622 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell0:SELECT=3 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:52:55.848039 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell0:SELECT=3 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:52:57.253939 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-acea9e5d-d120-49bf-9b35-9f015f7ec6f9 tempest-VolumesNegativeTest-532189680 tempest-VolumesNegativeTest-532189680-project] Action: 'create', calling method: .version_select at 0x7fed02448430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-823991127", "metadata": {"Type": "work"}}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:52:57.260687 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-acea9e5d-d120-49bf-9b35-9f015f7ec6f9 tempest-VolumesNegativeTest-532189680 tempest-VolumesNegativeTest-532189680-project] Request method failure captured: Sep 12 23:52:57.260687 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 12 23:52:57.260687 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Accept: application/json Sep 12 23:52:57.260687 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Sep 12 23:52:57.260687 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Connection: close Sep 12 23:52:57.260687 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Content-Length: 121 Sep 12 23:52:57.260687 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Content-Type: application/json Sep 12 23:52:57.260687 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Host: 10.222.0.26 Sep 12 23:52:57.260687 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Sep 12 23:52:57.260687 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Sep 12 23:52:57.260687 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjH8ZX7SoXrpfIOF5pgO2DSlldicUj9hYrxn5q0GaQjD6d0A4c4TRGREaX7J0cfB6pnPVCQojctAYeNuERvCnMs8WW0ydaRZl0eFrexL04FIXDlJIac680EwY8T_ufXfApZwpf8-WZokmHkhbeVwF1tPxBCJXQ7lsaELtGfYmnIvNeK24 Sep 12 23:52:57.260687 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Sep 12 23:52:57.260687 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Sep 12 23:52:57.260687 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Sep 12 23:52:57.260687 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Sep 12 23:52:57.260687 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Sep 12 23:52:57.260687 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Sep 12 23:52:57.260687 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Id: e775a06b78204f9192086fd27345738e Sep 12 23:52:57.260687 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-VolumesNegativeTest-532189680 Sep 12 23:52:57.260687 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Role: member,reader Sep 12 23:52:57.260687 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Roles: member,reader Sep 12 23:52:57.264226 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e775a06b78204f9192086fd27345738e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e775a06b78204f9192086fd27345738e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e775a06b78204f9192086fd27345738e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e775a06b78204f9192086fd27345738e"}]}] Sep 12 23:52:57.264226 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-VolumesNegativeTest-532189680 Sep 12 23:52:57.264226 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant-Id: e775a06b78204f9192086fd27345738e Sep 12 23:52:57.264226 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-VolumesNegativeTest-532189680 Sep 12 23:52:57.264226 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User: tempest-VolumesNegativeTest-532189680-project Sep 12 23:52:57.264226 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Sep 12 23:52:57.264226 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Sep 12 23:52:57.264226 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Id: a68446ca08104be0bdbc41df89c8dc9a Sep 12 23:52:57.264226 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-VolumesNegativeTest-532189680-project Sep 12 23:52:57.264226 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Sep 12 23:52:57.264226 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-823991127", "metadata": {"Type": "work"}}} Sep 12 23:52:57.264226 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: method: Sep 12 23:52:57.264226 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 12 23:52:57.267043 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-823991127', 'metadata': {'Type': 'work'}}}} Sep 12 23:52:57.267043 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:52:57.267043 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:52:57.267043 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 12 23:52:57.267043 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 12 23:52:57.267043 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 12 23:52:57.267043 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise error Sep 12 23:52:57.267043 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 12 23:52:57.267043 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:52:57.267043 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 12 23:52:57.267043 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 12 23:52:57.267043 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:52:57.267043 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 12 23:52:57.267043 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi '#$%' Sep 12 23:52:57.267043 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:52:57.267043 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:52:57.267043 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:52:57.267043 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:52:57.267043 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:52:57.267043 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:52:57.267043 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:52:57.267043 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:52:57.271076 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 12 23:52:57.271076 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 12 23:52:57.271076 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:52:57.271076 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:52:57.271076 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 12 23:52:57.271076 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 12 23:52:57.271076 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 12 23:52:57.271076 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 12 23:52:57.271076 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 12 23:52:57.271076 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 12 23:52:57.271076 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 12 23:52:57.271076 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:52:57.271076 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:52:57.271076 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:52:57.271076 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:52:57.271076 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:52:57.271076 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:52:57.271076 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 12 23:52:57.271076 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 12 23:52:57.273534 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 12 23:52:57.273534 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:52:57.273534 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-acea9e5d-d120-49bf-9b35-9f015f7ec6f9 tempest-VolumesNegativeTest-532189680 tempest-VolumesNegativeTest-532189680-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:52:57.273534 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-acea9e5d-d120-49bf-9b35-9f015f7ec6f9 tempest-VolumesNegativeTest-532189680 tempest-VolumesNegativeTest-532189680-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.441167 Sep 12 23:52:57.273534 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 1/1] 10.222.0.26 () {60 vars in 1156 bytes} [Mon Sep 12 23:52:55 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1444 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 12 23:52:57.276973 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=3 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:52:57.278067 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=3 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:52:57.279122 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell0:SELECT=3 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:52:57.282371 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell0:SELECT=3 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:52:57.660136 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ae87e65b-8c01-4e5c-9ed9-c5c55155f277 tempest-VolumesNegativeTest-532189680 tempest-VolumesNegativeTest-532189680-project] Action: 'create', calling method: .version_select at 0x7fed024feee0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-710202438", "metadata": {"Type": "work"}}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:52:57.668688 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ae87e65b-8c01-4e5c-9ed9-c5c55155f277 tempest-VolumesNegativeTest-532189680 tempest-VolumesNegativeTest-532189680-project] Request method failure captured: Sep 12 23:52:57.668688 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 12 23:52:57.668688 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept: application/json Sep 12 23:52:57.668688 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Sep 12 23:52:57.668688 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Connection: close Sep 12 23:52:57.668688 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Length: 119 Sep 12 23:52:57.668688 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Type: application/json Sep 12 23:52:57.668688 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Host: 10.222.0.26 Sep 12 23:52:57.668688 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Sep 12 23:52:57.668688 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Sep 12 23:52:57.668688 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjH8ZX7SoXrpfIOF5pgO2DSlldicUj9hYrxn5q0GaQjD6d0A4c4TRGREaX7J0cfB6pnPVCQojctAYeNuERvCnMs8WW0ydaRZl0eFrexL04FIXDlJIac680EwY8T_ufXfApZwpf8-WZokmHkhbeVwF1tPxBCJXQ7lsaELtGfYmnIvNeK24 Sep 12 23:52:57.668688 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Sep 12 23:52:57.668688 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Sep 12 23:52:57.668688 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Sep 12 23:52:57.668688 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Sep 12 23:52:57.668688 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Sep 12 23:52:57.668688 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Sep 12 23:52:57.668688 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Id: e775a06b78204f9192086fd27345738e Sep 12 23:52:57.668688 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-VolumesNegativeTest-532189680 Sep 12 23:52:57.668688 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Role: member,reader Sep 12 23:52:57.668688 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Roles: member,reader Sep 12 23:52:57.670218 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e775a06b78204f9192086fd27345738e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e775a06b78204f9192086fd27345738e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e775a06b78204f9192086fd27345738e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e775a06b78204f9192086fd27345738e"}]}] Sep 12 23:52:57.670218 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-VolumesNegativeTest-532189680 Sep 12 23:52:57.670218 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Id: e775a06b78204f9192086fd27345738e Sep 12 23:52:57.670218 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-VolumesNegativeTest-532189680 Sep 12 23:52:57.670218 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User: tempest-VolumesNegativeTest-532189680-project Sep 12 23:52:57.670218 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Sep 12 23:52:57.670218 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Sep 12 23:52:57.670218 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Id: a68446ca08104be0bdbc41df89c8dc9a Sep 12 23:52:57.670218 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-VolumesNegativeTest-532189680-project Sep 12 23:52:57.670218 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Sep 12 23:52:57.670218 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-710202438", "metadata": {"Type": "work"}}} Sep 12 23:52:57.670218 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: method: Sep 12 23:52:57.670218 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 12 23:52:57.671012 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-710202438', 'metadata': {'Type': 'work'}}}} Sep 12 23:52:57.671012 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:52:57.671012 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:52:57.671012 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 12 23:52:57.671012 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 12 23:52:57.671012 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 12 23:52:57.671012 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise error Sep 12 23:52:57.671012 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 12 23:52:57.671012 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:52:57.671012 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 12 23:52:57.671012 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 12 23:52:57.671012 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:52:57.671012 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 12 23:52:57.671012 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi '0' Sep 12 23:52:57.671012 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:52:57.671012 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:52:57.671012 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:52:57.671012 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:52:57.671012 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:52:57.671012 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:52:57.671012 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:52:57.671012 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:52:57.672295 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 12 23:52:57.672295 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 12 23:52:57.672295 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:52:57.672295 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:52:57.672295 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 12 23:52:57.672295 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 12 23:52:57.672295 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 12 23:52:57.672295 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 12 23:52:57.672295 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 12 23:52:57.672295 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 12 23:52:57.672295 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 12 23:52:57.672295 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:52:57.672295 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:52:57.672295 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:52:57.672295 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:52:57.672295 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:52:57.672295 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:52:57.672295 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 12 23:52:57.672295 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 12 23:52:57.673338 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 12 23:52:57.673338 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:52:57.676057 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ae87e65b-8c01-4e5c-9ed9-c5c55155f277 tempest-VolumesNegativeTest-532189680 tempest-VolumesNegativeTest-532189680-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:52:57.677451 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ae87e65b-8c01-4e5c-9ed9-c5c55155f277 tempest-VolumesNegativeTest-532189680 tempest-VolumesNegativeTest-532189680-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.406400 Sep 12 23:52:57.678961 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 1/2] 10.222.0.26 () {60 vars in 1156 bytes} [Mon Sep 12 23:52:57 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 409 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 12 23:52:57.696899 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3891c53a-f05d-473b-8169-a21b15a697d0 tempest-VolumesNegativeTest-532189680 tempest-VolumesNegativeTest-532189680-project] Action: 'create', calling method: .version_select at 0x7fed02448d30>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-493571957", "metadata": {"Type": "work"}}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:52:57.715968 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3891c53a-f05d-473b-8169-a21b15a697d0 tempest-VolumesNegativeTest-532189680 tempest-VolumesNegativeTest-532189680-project] Request method failure captured: Sep 12 23:52:57.715968 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 12 23:52:57.715968 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Accept: application/json Sep 12 23:52:57.715968 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Sep 12 23:52:57.715968 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Connection: close Sep 12 23:52:57.715968 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Content-Length: 118 Sep 12 23:52:57.715968 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Content-Type: application/json Sep 12 23:52:57.715968 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Host: 10.222.0.26 Sep 12 23:52:57.715968 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Sep 12 23:52:57.715968 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Sep 12 23:52:57.715968 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjH8ZX7SoXrpfIOF5pgO2DSlldicUj9hYrxn5q0GaQjD6d0A4c4TRGREaX7J0cfB6pnPVCQojctAYeNuERvCnMs8WW0ydaRZl0eFrexL04FIXDlJIac680EwY8T_ufXfApZwpf8-WZokmHkhbeVwF1tPxBCJXQ7lsaELtGfYmnIvNeK24 Sep 12 23:52:57.715968 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Sep 12 23:52:57.715968 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Sep 12 23:52:57.715968 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Sep 12 23:52:57.715968 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Sep 12 23:52:57.715968 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Sep 12 23:52:57.715968 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Sep 12 23:52:57.715968 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Id: e775a06b78204f9192086fd27345738e Sep 12 23:52:57.715968 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-VolumesNegativeTest-532189680 Sep 12 23:52:57.715968 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Role: member,reader Sep 12 23:52:57.715968 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Roles: member,reader Sep 12 23:52:57.717347 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e775a06b78204f9192086fd27345738e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e775a06b78204f9192086fd27345738e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e775a06b78204f9192086fd27345738e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e775a06b78204f9192086fd27345738e"}]}] Sep 12 23:52:57.717347 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-VolumesNegativeTest-532189680 Sep 12 23:52:57.717347 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant-Id: e775a06b78204f9192086fd27345738e Sep 12 23:52:57.717347 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-VolumesNegativeTest-532189680 Sep 12 23:52:57.717347 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User: tempest-VolumesNegativeTest-532189680-project Sep 12 23:52:57.717347 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Sep 12 23:52:57.717347 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Sep 12 23:52:57.717347 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Id: a68446ca08104be0bdbc41df89c8dc9a Sep 12 23:52:57.717347 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-VolumesNegativeTest-532189680-project Sep 12 23:52:57.717347 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Sep 12 23:52:57.717347 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-493571957", "metadata": {"Type": "work"}}} Sep 12 23:52:57.717347 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: method: Sep 12 23:52:57.717347 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 12 23:52:57.718103 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-493571957', 'metadata': {'Type': 'work'}}}} Sep 12 23:52:57.718103 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:52:57.718103 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:52:57.718103 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 12 23:52:57.718103 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 12 23:52:57.718103 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 12 23:52:57.718103 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise error Sep 12 23:52:57.718103 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 12 23:52:57.718103 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:52:57.718103 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 12 23:52:57.718103 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 12 23:52:57.718103 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:52:57.718103 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 12 23:52:57.718103 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi '' Sep 12 23:52:57.718103 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:52:57.718103 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:52:57.718103 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:52:57.718103 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:52:57.718103 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:52:57.718103 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:52:57.718103 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:52:57.718103 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:52:57.719381 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 12 23:52:57.719381 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 12 23:52:57.719381 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:52:57.719381 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:52:57.719381 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 12 23:52:57.719381 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 12 23:52:57.719381 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 12 23:52:57.719381 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 12 23:52:57.719381 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 12 23:52:57.719381 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 12 23:52:57.719381 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 12 23:52:57.719381 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:52:57.719381 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:52:57.719381 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:52:57.719381 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:52:57.719381 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:52:57.719381 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:52:57.719381 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 12 23:52:57.719381 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 12 23:52:57.720464 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 12 23:52:57.720464 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:52:57.720464 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3891c53a-f05d-473b-8169-a21b15a697d0 tempest-VolumesNegativeTest-532189680 tempest-VolumesNegativeTest-532189680-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:52:57.720464 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3891c53a-f05d-473b-8169-a21b15a697d0 tempest-VolumesNegativeTest-532189680 tempest-VolumesNegativeTest-532189680-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.031092 Sep 12 23:52:57.737365 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-461edcd1-8125-47c1-8b57-7dc6a1583490 tempest-VolumesNegativeTest-532189680 tempest-VolumesNegativeTest-532189680-project] Calling method '.version_select at 0x7fed024ada60>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:52:57.742048 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 2/3] 10.222.0.26 () {60 vars in 1156 bytes} [Mon Sep 12 23:52:57 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 56 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 12 23:52:58.762343 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-df437254-68d8-483b-8108-d1f71a2a6553 tempest-VolumesTestJSON-1628255975 tempest-VolumesTestJSON-1628255975-project] Calling method '.version_select at 0x7fed02301160>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:52:58.917152 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-461edcd1-8125-47c1-8b57-7dc6a1583490 tempest-VolumesNegativeTest-532189680 tempest-VolumesNegativeTest-532189680-project] HTTP exception thrown: Volume tempest-invalid-107747866 could not be found. Sep 12 23:52:58.937364 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-461edcd1-8125-47c1-8b57-7dc6a1583490 tempest-VolumesNegativeTest-532189680 tempest-VolumesNegativeTest-532189680-project] Request method failure captured: Sep 12 23:52:58.937364 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-107747866 HTTP/1.1 Sep 12 23:52:58.937364 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept: application/json Sep 12 23:52:58.937364 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Sep 12 23:52:58.937364 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Connection: close Sep 12 23:52:58.937364 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Length: 0 Sep 12 23:52:58.937364 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Type: application/json Sep 12 23:52:58.937364 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Host: 10.222.0.26 Sep 12 23:52:58.937364 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Sep 12 23:52:58.937364 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Sep 12 23:52:58.937364 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjH8ZX7SoXrpfIOF5pgO2DSlldicUj9hYrxn5q0GaQjD6d0A4c4TRGREaX7J0cfB6pnPVCQojctAYeNuERvCnMs8WW0ydaRZl0eFrexL04FIXDlJIac680EwY8T_ufXfApZwpf8-WZokmHkhbeVwF1tPxBCJXQ7lsaELtGfYmnIvNeK24 Sep 12 23:52:58.937364 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Sep 12 23:52:58.937364 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Sep 12 23:52:58.937364 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Sep 12 23:52:58.937364 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Sep 12 23:52:58.937364 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Sep 12 23:52:58.937364 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Sep 12 23:52:58.937364 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Id: e775a06b78204f9192086fd27345738e Sep 12 23:52:58.937364 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-VolumesNegativeTest-532189680 Sep 12 23:52:58.937364 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Role: member,reader Sep 12 23:52:58.937364 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Roles: member,reader Sep 12 23:52:58.939063 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e775a06b78204f9192086fd27345738e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e775a06b78204f9192086fd27345738e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e775a06b78204f9192086fd27345738e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e775a06b78204f9192086fd27345738e"}]}] Sep 12 23:52:58.939063 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-VolumesNegativeTest-532189680 Sep 12 23:52:58.939063 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Id: e775a06b78204f9192086fd27345738e Sep 12 23:52:58.939063 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-VolumesNegativeTest-532189680 Sep 12 23:52:58.939063 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User: tempest-VolumesNegativeTest-532189680-project Sep 12 23:52:58.939063 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Sep 12 23:52:58.939063 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Sep 12 23:52:58.939063 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Id: a68446ca08104be0bdbc41df89c8dc9a Sep 12 23:52:58.939063 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-VolumesNegativeTest-532189680-project Sep 12 23:52:58.939063 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: method: Sep 12 23:52:58.939063 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: exception: Volume tempest-invalid-107747866 could not be found. Sep 12 23:52:58.939063 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: action_args: {'id': 'tempest-invalid-107747866'} Sep 12 23:52:58.939063 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:52:58.940040 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:52:58.940040 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 12 23:52:58.940040 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 12 23:52:58.940040 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 12 23:52:58.940040 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 12 23:52:58.940040 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 12 23:52:58.940040 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 12 23:52:58.940040 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 12 23:52:58.940040 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 12 23:52:58.940040 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 12 23:52:58.940040 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 12 23:52:58.940040 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 12 23:52:58.940040 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 12 23:52:58.940040 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 12 23:52:58.940040 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 12 23:52:58.940040 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-107747866 could not be found. (HTTP 404) (Request-ID: req-ad940a26-c9b3-4b2b-94b0-892ed56dab41) Sep 12 23:52:58.940040 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:52:58.940040 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:52:58.940040 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:52:58.941438 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:52:58.941438 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 12 23:52:58.941438 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 12 23:52:58.941438 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 12 23:52:58.941438 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 12 23:52:58.941438 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 12 23:52:58.941438 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 12 23:52:58.941438 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 12 23:52:58.941438 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 12 23:52:58.941438 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 12 23:52:58.941438 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 12 23:52:58.941438 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 12 23:52:58.941438 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 12 23:52:58.941438 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 12 23:52:58.941438 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 12 23:52:58.941438 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 12 23:52:58.941438 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 12 23:52:58.941438 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 12 23:52:58.941438 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 12 23:52:58.942739 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 12 23:52:58.942739 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 12 23:52:58.942739 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 12 23:52:58.942739 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 12 23:52:58.942739 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-107747866 could not be found. Sep 12 23:52:58.942739 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:52:58.942739 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:52:58.942739 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:52:58.942739 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:52:58.942739 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:52:58.942739 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:52:58.942739 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:52:58.942739 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:52:58.942739 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 12 23:52:58.942739 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 12 23:52:58.942739 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:52:58.942739 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:52:58.942739 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 12 23:52:58.942739 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:52:58.942739 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-107747866 could not be found. Sep 12 23:52:58.944189 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:52:58.944189 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:52:58.944189 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:52:58.944189 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:52:58.944189 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:52:58.944189 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:52:58.944189 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:52:58.944189 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:52:58.944189 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-107747866 could not be found. Sep 12 23:52:58.944189 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:52:58.944189 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-461edcd1-8125-47c1-8b57-7dc6a1583490 tempest-VolumesNegativeTest-532189680 tempest-VolumesNegativeTest-532189680-project] Returning 404 to user: Volume tempest-invalid-107747866 could not be found. {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:52:58.946212 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-461edcd1-8125-47c1-8b57-7dc6a1583490 tempest-VolumesNegativeTest-532189680 tempest-VolumesNegativeTest-532189680-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/tempest-invalid-107747866" status: 404 len: 98 microversion: 2.1 time: 1.215930 Sep 12 23:52:58.953936 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 2/4] 10.222.0.26 () {58 vars in 1215 bytes} [Mon Sep 12 23:52:57 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-107747866 => generated 98 bytes in 1224 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 12 23:52:58.980654 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b2606d2d-eeaf-4b06-ae66-ef752c399781 tempest-VolumesNegativeTest-532189680 tempest-VolumesNegativeTest-532189680-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.021293 Sep 12 23:52:58.986535 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 3/5] 10.222.0.26 () {58 vars in 1140 bytes} [Mon Sep 12 23:52:58 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 12 23:52:59.010019 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-88a36e18-fe3f-4f38-9a4e-b7f99e161ea1 tempest-VolumesNegativeTest-532189680 tempest-VolumesNegativeTest-532189680-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.012079 Sep 12 23:52:59.011962 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 4/6] 10.222.0.26 () {58 vars in 1137 bytes} [Mon Sep 12 23:52:58 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 18 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 12 23:52:59.049337 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-625bda53-2092-4560-bcc8-191fab21e335 tempest-VolumesNegativeTest-532189680 tempest-VolumesNegativeTest-532189680-project] Calling method '.version_select at 0x7fed02283b80>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:52:59.178236 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-625bda53-2092-4560-bcc8-191fab21e335 tempest-VolumesNegativeTest-532189680 tempest-VolumesNegativeTest-532189680-project] HTTP exception thrown: Volume a1ce94e7-c317-455a-b57a-d9f5e447612c could not be found. Sep 12 23:52:59.183371 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-625bda53-2092-4560-bcc8-191fab21e335 tempest-VolumesNegativeTest-532189680 tempest-VolumesNegativeTest-532189680-project] Request method failure captured: Sep 12 23:52:59.183371 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: request: DELETE /compute/v2.1/os-volumes/a1ce94e7-c317-455a-b57a-d9f5e447612c HTTP/1.1 Sep 12 23:52:59.183371 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept: application/json Sep 12 23:52:59.183371 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Sep 12 23:52:59.183371 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Connection: close Sep 12 23:52:59.183371 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Length: 0 Sep 12 23:52:59.183371 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Type: application/json Sep 12 23:52:59.183371 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Host: 10.222.0.26 Sep 12 23:52:59.183371 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Sep 12 23:52:59.183371 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Sep 12 23:52:59.183371 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjH8ZX7SoXrpfIOF5pgO2DSlldicUj9hYrxn5q0GaQjD6d0A4c4TRGREaX7J0cfB6pnPVCQojctAYeNuERvCnMs8WW0ydaRZl0eFrexL04FIXDlJIac680EwY8T_ufXfApZwpf8-WZokmHkhbeVwF1tPxBCJXQ7lsaELtGfYmnIvNeK24 Sep 12 23:52:59.183371 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Sep 12 23:52:59.183371 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Sep 12 23:52:59.183371 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Sep 12 23:52:59.183371 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Sep 12 23:52:59.183371 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Sep 12 23:52:59.183371 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Sep 12 23:52:59.183371 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Id: e775a06b78204f9192086fd27345738e Sep 12 23:52:59.183371 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-VolumesNegativeTest-532189680 Sep 12 23:52:59.183371 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Role: member,reader Sep 12 23:52:59.183371 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Roles: member,reader Sep 12 23:52:59.186185 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e775a06b78204f9192086fd27345738e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e775a06b78204f9192086fd27345738e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e775a06b78204f9192086fd27345738e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e775a06b78204f9192086fd27345738e"}]}] Sep 12 23:52:59.186185 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-VolumesNegativeTest-532189680 Sep 12 23:52:59.186185 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Id: e775a06b78204f9192086fd27345738e Sep 12 23:52:59.186185 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-VolumesNegativeTest-532189680 Sep 12 23:52:59.186185 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User: tempest-VolumesNegativeTest-532189680-project Sep 12 23:52:59.186185 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Sep 12 23:52:59.186185 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Sep 12 23:52:59.186185 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Id: a68446ca08104be0bdbc41df89c8dc9a Sep 12 23:52:59.186185 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-VolumesNegativeTest-532189680-project Sep 12 23:52:59.186185 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: method: Sep 12 23:52:59.186185 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: exception: Volume a1ce94e7-c317-455a-b57a-d9f5e447612c could not be found. Sep 12 23:52:59.186185 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: action_args: {'id': 'a1ce94e7-c317-455a-b57a-d9f5e447612c'} Sep 12 23:52:59.186185 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:52:59.188201 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:52:59.188201 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 12 23:52:59.188201 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 12 23:52:59.188201 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 12 23:52:59.188201 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 12 23:52:59.188201 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 12 23:52:59.188201 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 12 23:52:59.188201 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 12 23:52:59.188201 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 12 23:52:59.188201 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 12 23:52:59.188201 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 12 23:52:59.188201 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 12 23:52:59.188201 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 12 23:52:59.188201 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 12 23:52:59.188201 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 12 23:52:59.188201 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a1ce94e7-c317-455a-b57a-d9f5e447612c could not be found. (HTTP 404) (Request-ID: req-c6b1a464-7e01-4cf3-ae34-1b212f850c06) Sep 12 23:52:59.188201 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:52:59.188201 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:52:59.188201 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:52:59.191847 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:52:59.191847 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 12 23:52:59.191847 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 12 23:52:59.191847 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 12 23:52:59.191847 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 12 23:52:59.191847 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 12 23:52:59.191847 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 12 23:52:59.191847 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 12 23:52:59.191847 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 12 23:52:59.191847 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 12 23:52:59.191847 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 12 23:52:59.191847 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 12 23:52:59.191847 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 12 23:52:59.191847 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 12 23:52:59.191847 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 12 23:52:59.191847 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 12 23:52:59.191847 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 12 23:52:59.191847 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 12 23:52:59.191847 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 12 23:52:59.196618 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 12 23:52:59.196618 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 12 23:52:59.196618 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 12 23:52:59.196618 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 12 23:52:59.196618 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a1ce94e7-c317-455a-b57a-d9f5e447612c could not be found. Sep 12 23:52:59.196618 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:52:59.196618 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:52:59.196618 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:52:59.196618 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:52:59.196618 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:52:59.196618 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:52:59.196618 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:52:59.196618 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:52:59.196618 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 12 23:52:59.196618 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 12 23:52:59.196618 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:52:59.196618 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:52:59.196618 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 12 23:52:59.196618 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:52:59.202381 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a1ce94e7-c317-455a-b57a-d9f5e447612c could not be found. Sep 12 23:52:59.202381 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:52:59.202381 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:52:59.202381 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:52:59.202381 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:52:59.202381 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:52:59.202381 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:52:59.202381 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:52:59.202381 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:52:59.202381 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a1ce94e7-c317-455a-b57a-d9f5e447612c could not be found. Sep 12 23:52:59.202381 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:52:59.202381 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-625bda53-2092-4560-bcc8-191fab21e335 tempest-VolumesNegativeTest-532189680 tempest-VolumesNegativeTest-532189680-project] Returning 404 to user: Volume a1ce94e7-c317-455a-b57a-d9f5e447612c could not be found. {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:52:59.205283 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-625bda53-2092-4560-bcc8-191fab21e335 tempest-VolumesNegativeTest-532189680 tempest-VolumesNegativeTest-532189680-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/a1ce94e7-c317-455a-b57a-d9f5e447612c" status: 404 len: 109 microversion: 2.1 time: 0.178206 Sep 12 23:52:59.206297 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 5/7] 10.222.0.26 () {58 vars in 1248 bytes} [Mon Sep 12 23:52:59 2022] DELETE /compute/v2.1/os-volumes/a1ce94e7-c317-455a-b57a-d9f5e447612c => generated 109 bytes in 181 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:52:59.228804 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0af81691-6b8a-45c5-bd69-0e6eef8c1207 tempest-VolumesNegativeTest-532189680 tempest-VolumesNegativeTest-532189680-project] Calling method '.version_select at 0x7fed0222f8b0>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:52:59.348242 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-0af81691-6b8a-45c5-bd69-0e6eef8c1207 tempest-VolumesNegativeTest-532189680 tempest-VolumesNegativeTest-532189680-project] HTTP exception thrown: Volume 8dd0ab5b-5dab-4532-9bbf-b83819f1c111 could not be found. Sep 12 23:52:59.352490 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0af81691-6b8a-45c5-bd69-0e6eef8c1207 tempest-VolumesNegativeTest-532189680 tempest-VolumesNegativeTest-532189680-project] Request method failure captured: Sep 12 23:52:59.352490 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: request: GET /compute/v2.1/os-volumes/8dd0ab5b-5dab-4532-9bbf-b83819f1c111 HTTP/1.1 Sep 12 23:52:59.352490 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept: application/json Sep 12 23:52:59.352490 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Sep 12 23:52:59.352490 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Connection: close Sep 12 23:52:59.352490 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Length: 0 Sep 12 23:52:59.352490 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Type: application/json Sep 12 23:52:59.352490 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Host: 10.222.0.26 Sep 12 23:52:59.352490 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Sep 12 23:52:59.352490 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Sep 12 23:52:59.352490 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjH8ZX7SoXrpfIOF5pgO2DSlldicUj9hYrxn5q0GaQjD6d0A4c4TRGREaX7J0cfB6pnPVCQojctAYeNuERvCnMs8WW0ydaRZl0eFrexL04FIXDlJIac680EwY8T_ufXfApZwpf8-WZokmHkhbeVwF1tPxBCJXQ7lsaELtGfYmnIvNeK24 Sep 12 23:52:59.352490 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Sep 12 23:52:59.352490 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Sep 12 23:52:59.352490 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Sep 12 23:52:59.352490 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Sep 12 23:52:59.352490 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Sep 12 23:52:59.352490 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Sep 12 23:52:59.352490 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Id: e775a06b78204f9192086fd27345738e Sep 12 23:52:59.352490 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-VolumesNegativeTest-532189680 Sep 12 23:52:59.352490 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Role: member,reader Sep 12 23:52:59.352490 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Roles: member,reader Sep 12 23:52:59.354781 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e775a06b78204f9192086fd27345738e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e775a06b78204f9192086fd27345738e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e775a06b78204f9192086fd27345738e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e775a06b78204f9192086fd27345738e"}]}] Sep 12 23:52:59.354781 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-VolumesNegativeTest-532189680 Sep 12 23:52:59.354781 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Id: e775a06b78204f9192086fd27345738e Sep 12 23:52:59.354781 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-VolumesNegativeTest-532189680 Sep 12 23:52:59.354781 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User: tempest-VolumesNegativeTest-532189680-project Sep 12 23:52:59.354781 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Sep 12 23:52:59.354781 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Sep 12 23:52:59.354781 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Id: a68446ca08104be0bdbc41df89c8dc9a Sep 12 23:52:59.354781 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-VolumesNegativeTest-532189680-project Sep 12 23:52:59.354781 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: method: Sep 12 23:52:59.354781 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: exception: Volume 8dd0ab5b-5dab-4532-9bbf-b83819f1c111 could not be found. Sep 12 23:52:59.354781 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: action_args: {'id': '8dd0ab5b-5dab-4532-9bbf-b83819f1c111'} Sep 12 23:52:59.354781 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:52:59.356307 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:52:59.356307 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 12 23:52:59.356307 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 12 23:52:59.356307 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 12 23:52:59.356307 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 12 23:52:59.356307 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 12 23:52:59.356307 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 12 23:52:59.356307 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 12 23:52:59.356307 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 12 23:52:59.356307 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 12 23:52:59.356307 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 12 23:52:59.356307 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 12 23:52:59.356307 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 12 23:52:59.356307 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 12 23:52:59.356307 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 12 23:52:59.356307 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8dd0ab5b-5dab-4532-9bbf-b83819f1c111 could not be found. (HTTP 404) (Request-ID: req-1cd9dea9-7cd3-41a3-a014-365611795e7f) Sep 12 23:52:59.356307 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:52:59.356307 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:52:59.356307 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:52:59.358399 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:52:59.358399 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 12 23:52:59.358399 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 12 23:52:59.358399 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 12 23:52:59.358399 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 12 23:52:59.358399 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 12 23:52:59.358399 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 12 23:52:59.358399 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 12 23:52:59.358399 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 12 23:52:59.358399 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 12 23:52:59.358399 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 12 23:52:59.358399 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 12 23:52:59.358399 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 12 23:52:59.358399 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 12 23:52:59.358399 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 12 23:52:59.358399 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 12 23:52:59.358399 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 12 23:52:59.358399 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 12 23:52:59.358399 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 12 23:52:59.360802 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 12 23:52:59.360802 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 12 23:52:59.360802 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 12 23:52:59.360802 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 12 23:52:59.360802 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8dd0ab5b-5dab-4532-9bbf-b83819f1c111 could not be found. Sep 12 23:52:59.360802 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:52:59.360802 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:52:59.360802 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:52:59.360802 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:52:59.360802 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:52:59.360802 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:52:59.360802 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:52:59.360802 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:52:59.360802 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 12 23:52:59.360802 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 12 23:52:59.360802 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:52:59.360802 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:52:59.360802 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 12 23:52:59.360802 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:52:59.362515 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8dd0ab5b-5dab-4532-9bbf-b83819f1c111 could not be found. Sep 12 23:52:59.362515 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:52:59.362515 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:52:59.362515 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:52:59.362515 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:52:59.362515 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:52:59.362515 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:52:59.362515 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:52:59.362515 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:52:59.362515 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8dd0ab5b-5dab-4532-9bbf-b83819f1c111 could not be found. Sep 12 23:52:59.362515 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:52:59.362515 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0af81691-6b8a-45c5-bd69-0e6eef8c1207 tempest-VolumesNegativeTest-532189680 tempest-VolumesNegativeTest-532189680-project] Returning 404 to user: Volume 8dd0ab5b-5dab-4532-9bbf-b83819f1c111 could not be found. {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:52:59.362515 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0af81691-6b8a-45c5-bd69-0e6eef8c1207 tempest-VolumesNegativeTest-532189680 tempest-VolumesNegativeTest-532189680-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/8dd0ab5b-5dab-4532-9bbf-b83819f1c111" status: 404 len: 109 microversion: 2.1 time: 0.141581 Sep 12 23:52:59.362515 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 6/8] 10.222.0.26 () {58 vars in 1245 bytes} [Mon Sep 12 23:52:59 2022] GET /compute/v2.1/os-volumes/8dd0ab5b-5dab-4532-9bbf-b83819f1c111 => generated 109 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:52:59.977634 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-df437254-68d8-483b-8108-d1f71a2a6553 tempest-VolumesTestJSON-1628255975 tempest-VolumesTestJSON-1628255975-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/ac9363e8-9767-493b-8e72-a78382824a58" status: 200 len: 350 microversion: 2.1 time: 1.219337 Sep 12 23:52:59.978680 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 3/9] 10.222.0.26 () {58 vars in 1245 bytes} [Mon Sep 12 23:52:58 2022] GET /compute/v2.1/os-volumes/ac9363e8-9767-493b-8e72-a78382824a58 => generated 350 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 23:53:01.919380 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2b722626-2e9b-4bc4-ac62-8fd378d251ad tempest-VolumesTestJSON-1628255975 tempest-VolumesTestJSON-1628255975-project] Calling method '.version_select at 0x7fed02327670>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:02.057175 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2b722626-2e9b-4bc4-ac62-8fd378d251ad tempest-VolumesTestJSON-1628255975 tempest-VolumesTestJSON-1628255975-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/d4b208ff-0af8-49bd-a33c-d0503527517b" status: 200 len: 351 microversion: 2.1 time: 0.145244 Sep 12 23:53:02.058022 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 7/10] 10.222.0.26 () {58 vars in 1245 bytes} [Mon Sep 12 23:53:01 2022] GET /compute/v2.1/os-volumes/d4b208ff-0af8-49bd-a33c-d0503527517b => generated 351 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:53:04.124310 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-82857816-5fae-48b9-b1b5-be1d58366a47 tempest-VolumesTestJSON-1628255975 tempest-VolumesTestJSON-1628255975-project] Calling method '.version_select at 0x7fed022d78b0>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:04.276990 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-82857816-5fae-48b9-b1b5-be1d58366a47 tempest-VolumesTestJSON-1628255975 tempest-VolumesTestJSON-1628255975-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/b5512f4d-c7e5-460e-998a-c84fb3b225f1" status: 200 len: 351 microversion: 2.1 time: 0.167821 Sep 12 23:53:04.278099 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 4/11] 10.222.0.26 () {58 vars in 1245 bytes} [Mon Sep 12 23:53:04 2022] GET /compute/v2.1/os-volumes/b5512f4d-c7e5-460e-998a-c84fb3b225f1 => generated 351 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:53:04.306729 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-385ebfc8-016c-48d2-b8ca-96d9b6bf442f tempest-VolumesTestJSON-1628255975 tempest-VolumesTestJSON-1628255975-project] Calling method '.version_select at 0x7fed0222fa60>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:04.475432 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-385ebfc8-016c-48d2-b8ca-96d9b6bf442f tempest-VolumesTestJSON-1628255975 tempest-VolumesTestJSON-1628255975-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.176479 Sep 12 23:53:04.477723 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 8/12] 10.222.0.26 () {58 vars in 1134 bytes} [Mon Sep 12 23:53:04 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:53:04.513255 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4ba33d12-22a4-4742-a259-35356844bd91 tempest-VolumesTestJSON-1628255975 tempest-VolumesTestJSON-1628255975-project] Calling method '.version_select at 0x7fed022d7af0>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:04.784329 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-4ba33d12-22a4-4742-a259-35356844bd91 tempest-VolumesTestJSON-1628255975 tempest-VolumesTestJSON-1628255975-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.282259 Sep 12 23:53:04.785822 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 5/13] 10.222.0.26 () {58 vars in 1149 bytes} [Mon Sep 12 23:53:04 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:53:04.817529 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f7e0b9e5-cf40-43f9-b93a-7200b1992964 tempest-VolumesTestJSON-1628255975 tempest-VolumesTestJSON-1628255975-project] Calling method '.version_select at 0x7fed022839d0>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:05.189269 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f7e0b9e5-cf40-43f9-b93a-7200b1992964 tempest-VolumesTestJSON-1628255975 tempest-VolumesTestJSON-1628255975-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.380782 Sep 12 23:53:05.190703 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 9/14] 10.222.0.26 () {58 vars in 1134 bytes} [Mon Sep 12 23:53:04 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:53:05.217211 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b13e043c-25ca-4f9e-90d1-c29682f98bb6 tempest-VolumesTestJSON-1628255975 tempest-VolumesTestJSON-1628255975-project] Calling method '.version_select at 0x7fed022e6d30>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:05.529441 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b13e043c-25ca-4f9e-90d1-c29682f98bb6 tempest-VolumesTestJSON-1628255975 tempest-VolumesTestJSON-1628255975-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.320178 Sep 12 23:53:05.532100 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 6/15] 10.222.0.26 () {58 vars in 1167 bytes} [Mon Sep 12 23:53:05 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:53:05.550218 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2efb4184-abaf-49f5-9e9f-7b5a365523ae tempest-VolumesTestJSON-1628255975 tempest-VolumesTestJSON-1628255975-project] Calling method '.version_select at 0x7fed02327670>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:05.827812 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2efb4184-abaf-49f5-9e9f-7b5a365523ae tempest-VolumesTestJSON-1628255975 tempest-VolumesTestJSON-1628255975-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.282881 Sep 12 23:53:05.829448 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 10/16] 10.222.0.26 () {58 vars in 1170 bytes} [Mon Sep 12 23:53:05 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:53:05.852145 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-db42cd36-5dcc-4d37-8db7-aea4a20fc42f tempest-VolumesTestJSON-1628255975 tempest-VolumesTestJSON-1628255975-project] Calling method '.version_select at 0x7fed022e6700>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:06.105023 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-db42cd36-5dcc-4d37-8db7-aea4a20fc42f tempest-VolumesTestJSON-1628255975 tempest-VolumesTestJSON-1628255975-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.262188 Sep 12 23:53:06.105619 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 7/17] 10.222.0.26 () {58 vars in 1155 bytes} [Mon Sep 12 23:53:05 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:53:06.121657 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-479bdfb5-2fac-45f5-aa7e-d5f2fd9603eb tempest-VolumesTestJSON-1628255975 tempest-VolumesTestJSON-1628255975-project] Calling method '.version_select at 0x7fed022390d0>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:06.400356 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-479bdfb5-2fac-45f5-aa7e-d5f2fd9603eb tempest-VolumesTestJSON-1628255975 tempest-VolumesTestJSON-1628255975-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.283518 Sep 12 23:53:06.401578 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 11/18] 10.222.0.26 () {58 vars in 1188 bytes} [Mon Sep 12 23:53:06 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:53:06.420707 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-669db051-99f2-43ff-95e7-a7b1006593dd tempest-VolumesTestJSON-1628255975 tempest-VolumesTestJSON-1628255975-project] Calling method '.version_select at 0x7fed022d7a60>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:06.816238 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-669db051-99f2-43ff-95e7-a7b1006593dd tempest-VolumesTestJSON-1628255975 tempest-VolumesTestJSON-1628255975-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.402059 Sep 12 23:53:06.817452 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 8/19] 10.222.0.26 () {58 vars in 1155 bytes} [Mon Sep 12 23:53:06 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:53:16.856080 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1631cacc-1824-421f-8d3b-885bad583671 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1350954057", "imageRef": "22a47167-5e04-441a-a504-d76d82afc776", "flavorRef": "452", "networks": [{"uuid": "5efdc9e4-8d20-4e9b-8531-580dd880dff0"}]}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:53:17.089660 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.network.neutron [None req-1631cacc-1824-421f-8d3b-885bad583671 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] validate_networks() for [('5efdc9e4-8d20-4e9b-8531-580dd880dff0', None, None, None, None, None)] {{(pid=126975) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 23:53:19.834255 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-027f24dc-7dcd-4bc2-ab8b-3a4162ec27c8 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1772986961", "imageRef": "22a47167-5e04-441a-a504-d76d82afc776", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:53:20.042022 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.network.neutron [None req-027f24dc-7dcd-4bc2-ab8b-3a4162ec27c8 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] validate_networks() for [('d12b1ca0-0f82-443c-a352-272c3b2c327e', None, None, None, None, None)] {{(pid=126976) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 23:53:21.976912 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-1631cacc-1824-421f-8d3b-885bad583671 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Flavor limits 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 23:53:21.977734 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-1631cacc-1824-421f-8d3b-885bad583671 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Image limits 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 23:53:21.977893 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-1631cacc-1824-421f-8d3b-885bad583671 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Flavor pref 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 23:53:21.978258 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-1631cacc-1824-421f-8d3b-885bad583671 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Image pref 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 23:53:21.978692 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-1631cacc-1824-421f-8d3b-885bad583671 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 23:53:22.039850 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1631cacc-1824-421f-8d3b-885bad583671 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:22.040358 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1631cacc-1824-421f-8d3b-885bad583671 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:22.040806 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1631cacc-1824-421f-8d3b-885bad583671 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:22.048820 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1631cacc-1824-421f-8d3b-885bad583671 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:22.049518 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1631cacc-1824-421f-8d3b-885bad583671 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:22.049978 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1631cacc-1824-421f-8d3b-885bad583671 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:22.173099 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-1631cacc-1824-421f-8d3b-885bad583671 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Getting quotas for project 58a7b6a5dc86486682777285fa3295ac. Resources: {'instances', 'cores', 'ram'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 23:53:22.200856 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-1631cacc-1824-421f-8d3b-885bad583671 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Getting quotas for user d46cf7ae501740869d677d0e9e007041 and project 58a7b6a5dc86486682777285fa3295ac. Resources: {'instances', 'cores', 'ram'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 23:53:22.280720 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1631cacc-1824-421f-8d3b-885bad583671 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Going to run 1 instances... {{(pid=126975) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 23:53:22.299174 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1631cacc-1824-421f-8d3b-885bad583671 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] [instance: cab7089c-6860-4148-9dd6-45939ee2c1a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='22a47167-5e04-441a-a504-d76d82afc776',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126975) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 23:53:22.817418 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1631cacc-1824-421f-8d3b-885bad583671 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.300257 Sep 12 23:53:22.825496 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 12/20] 10.222.0.26 () {60 vars in 1147 bytes} [Mon Sep 12 23:53:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 6313 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 12 23:53:22.875880 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-58291028-0682-4bf5-aba7-1cf554a0072a tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:22.886677 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-58291028-0682-4bf5-aba7-1cf554a0072a tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] [instance: cab7089c-6860-4148-9dd6-45939ee2c1a9] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:53:23.241997 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-58291028-0682-4bf5-aba7-1cf554a0072a tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46cf7ae501740869d677d0e9e007041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a7b6a5dc86486682777285fa3295ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:23.274033 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-58291028-0682-4bf5-aba7-1cf554a0072a tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] 10.222.0.26 "GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9" status: 200 len: 1215 microversion: 2.1 time: 0.425072 Sep 12 23:53:23.278308 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 13/21] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:53:22 2022] GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9 => generated 1215 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:53:23.640143 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-027f24dc-7dcd-4bc2-ab8b-3a4162ec27c8 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Flavor limits 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 23:53:23.640902 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-027f24dc-7dcd-4bc2-ab8b-3a4162ec27c8 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Image limits 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 23:53:23.641020 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-027f24dc-7dcd-4bc2-ab8b-3a4162ec27c8 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Flavor pref 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 23:53:23.641398 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-027f24dc-7dcd-4bc2-ab8b-3a4162ec27c8 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Image pref 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 23:53:23.642655 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-027f24dc-7dcd-4bc2-ab8b-3a4162ec27c8 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 23:53:23.688861 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-027f24dc-7dcd-4bc2-ab8b-3a4162ec27c8 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:23.689378 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-027f24dc-7dcd-4bc2-ab8b-3a4162ec27c8 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:23.689800 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-027f24dc-7dcd-4bc2-ab8b-3a4162ec27c8 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:23.690688 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-027f24dc-7dcd-4bc2-ab8b-3a4162ec27c8 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:23.691358 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-027f24dc-7dcd-4bc2-ab8b-3a4162ec27c8 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:23.691733 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-027f24dc-7dcd-4bc2-ab8b-3a4162ec27c8 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:23.873308 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-027f24dc-7dcd-4bc2-ab8b-3a4162ec27c8 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Getting quotas for project 6c458cf41ded4113a09fb07e10d81d39. Resources: {'instances', 'cores', 'ram'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 23:53:23.917996 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-027f24dc-7dcd-4bc2-ab8b-3a4162ec27c8 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Getting quotas for user 76eb39c2010e43aaa0a01caaea3a38b9 and project 6c458cf41ded4113a09fb07e10d81d39. Resources: {'instances', 'cores', 'ram'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 23:53:23.990598 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-027f24dc-7dcd-4bc2-ab8b-3a4162ec27c8 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Going to run 1 instances... {{(pid=126976) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 23:53:24.007843 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-027f24dc-7dcd-4bc2-ab8b-3a4162ec27c8 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 695586a7-2b4d-477b-ab83-9e74f5f7078a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='22a47167-5e04-441a-a504-d76d82afc776',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126976) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 23:53:24.291826 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-027f24dc-7dcd-4bc2-ab8b-3a4162ec27c8 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.995028 Sep 12 23:53:24.303570 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 9/22] 10.222.0.26 () {60 vars in 1147 bytes} [Mon Sep 12 23:53:19 2022] POST /compute/v2.1/servers => generated 383 bytes in 5009 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 12 23:53:24.322285 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5a6b6b6c-e9fb-4e11-ab20-34778b751976 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:24.322285 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5a6b6b6c-e9fb-4e11-ab20-34778b751976 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] [instance: cab7089c-6860-4148-9dd6-45939ee2c1a9] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:53:24.524140 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-5a6b6b6c-e9fb-4e11-ab20-34778b751976 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46cf7ae501740869d677d0e9e007041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a7b6a5dc86486682777285fa3295ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:24.604748 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5a6b6b6c-e9fb-4e11-ab20-34778b751976 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] 10.222.0.26 "GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9" status: 200 len: 1215 microversion: 2.1 time: 0.293988 Sep 12 23:53:24.607065 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 10/23] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:53:24 2022] GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9 => generated 1215 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:53:24.636630 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-81cc4228-89c6-404f-9342-27b506b81231 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:24.638243 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-81cc4228-89c6-404f-9342-27b506b81231 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 695586a7-2b4d-477b-ab83-9e74f5f7078a] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:53:25.013122 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-81cc4228-89c6-404f-9342-27b506b81231 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:25.029391 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-81cc4228-89c6-404f-9342-27b506b81231 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a" status: 200 len: 1222 microversion: 2.1 time: 0.413683 Sep 12 23:53:25.032287 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 11/24] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:53:24 2022] GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a => generated 1222 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:53:25.144868 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-94d2eb70-9d21-4fcf-bda7-e45a8da8d215 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Action: 'create', calling method: .version_select at 0x7fed0193e430>, body: {"keypair": {"name": "tempest-keypair-1902538849", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIREBeFWDKo9wezWiy85tcmlmF+FsbFyLk2yuQrHX+BwBh3jHR+cmqqwNZD94usxCT9VQ7Jm/NojIrF8NXP0FSGsMg8N4Xdokgys7ocFKOnhAYBR0lZC5EpXhYqXwUxwXw=="}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:53:25.262028 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-94d2eb70-9d21-4fcf-bda7-e45a8da8d215 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Getting quotas for project 6b2f385a651c408bb9d32b5c4e1ab6ff. Resources: {'key_pairs'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 23:53:25.291703 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-94d2eb70-9d21-4fcf-bda7-e45a8da8d215 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Getting quotas for user 296f02c73fc548969bf60df4f8f372b0 and project 6b2f385a651c408bb9d32b5c4e1ab6ff. Resources: {'key_pairs'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 23:53:25.453633 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-94d2eb70-9d21-4fcf-bda7-e45a8da8d215 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.173371 Sep 12 23:53:25.461119 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 14/25] 10.222.0.26 () {62 vars in 1200 bytes} [Mon Sep 12 23:53:24 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1180 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 12 23:53:25.478734 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-82637e6e-8847-41f7-8c00-5f8b95e6d272 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-914429533", "imageRef": "22a47167-5e04-441a-a504-d76d82afc776", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:53:25.631386 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.network.neutron [None req-82637e6e-8847-41f7-8c00-5f8b95e6d272 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] validate_networks() for [('d12b1ca0-0f82-443c-a352-272c3b2c327e', None, None, None, None, None)] {{(pid=126976) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 23:53:25.636431 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-408e07e9-72f6-48a3-a595-17c5874fdc69 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:25.637456 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-408e07e9-72f6-48a3-a595-17c5874fdc69 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] [instance: cab7089c-6860-4148-9dd6-45939ee2c1a9] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:53:26.473360 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-408e07e9-72f6-48a3-a595-17c5874fdc69 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46cf7ae501740869d677d0e9e007041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a7b6a5dc86486682777285fa3295ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:26.499306 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-408e07e9-72f6-48a3-a595-17c5874fdc69 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] 10.222.0.26 "GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9" status: 200 len: 1215 microversion: 2.1 time: 0.867636 Sep 12 23:53:26.500472 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 15/26] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:53:25 2022] GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9 => generated 1215 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:53:28.326925 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-be5a2637-e273-41cc-8b83-f7016b909ba1 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Action: 'create', calling method: .version_select at 0x7fed01962ca0>, body: {"keypair": {"name": "tempest-keypair-43140354", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrXNVKAwogifekKBnLcaQpQn+JLlSHEs+e0NZwMrxd0OVEVn2mQWjhqWDyr0GGr5sQIPqTQj7uM5F6De33DYiyQdjIvaCumh8rX5IsA6rhyULsFpOjZDduaLxeOSkGwzQ=="}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:53:28.384141 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-be5a2637-e273-41cc-8b83-f7016b909ba1 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Getting quotas for project 6c681f1232de4a5fbfc728c230f80624. Resources: {'key_pairs'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 23:53:28.392139 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-be5a2637-e273-41cc-8b83-f7016b909ba1 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Getting quotas for user a8cbfc74644f4d4594a70b833ad7002c and project 6c681f1232de4a5fbfc728c230f80624. Resources: {'key_pairs'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 23:53:28.541995 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-be5a2637-e273-41cc-8b83-f7016b909ba1 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 1.151293 Sep 12 23:53:28.543499 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 16/27] 10.222.0.26 () {60 vars in 1159 bytes} [Mon Sep 12 23:53:27 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:53:28.568150 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5a363d39-dd9b-48dc-92f1-3a5c2b31960a tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:28.572420 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5a363d39-dd9b-48dc-92f1-3a5c2b31960a tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] [instance: cab7089c-6860-4148-9dd6-45939ee2c1a9] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:53:28.594720 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5a363d39-dd9b-48dc-92f1-3a5c2b31960a tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:28.597803 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5a363d39-dd9b-48dc-92f1-3a5c2b31960a tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:28.600416 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5a363d39-dd9b-48dc-92f1-3a5c2b31960a tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:28.603871 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5a363d39-dd9b-48dc-92f1-3a5c2b31960a tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:28.605196 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5a363d39-dd9b-48dc-92f1-3a5c2b31960a tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:28.607055 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5a363d39-dd9b-48dc-92f1-3a5c2b31960a tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:29.108623 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-82637e6e-8847-41f7-8c00-5f8b95e6d272 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Flavor limits 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 23:53:29.110409 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-82637e6e-8847-41f7-8c00-5f8b95e6d272 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Image limits 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 23:53:29.111607 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-82637e6e-8847-41f7-8c00-5f8b95e6d272 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Flavor pref 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 23:53:29.112521 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-82637e6e-8847-41f7-8c00-5f8b95e6d272 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Image pref 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 23:53:29.113609 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-82637e6e-8847-41f7-8c00-5f8b95e6d272 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 23:53:29.166992 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-82637e6e-8847-41f7-8c00-5f8b95e6d272 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:29.167871 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-82637e6e-8847-41f7-8c00-5f8b95e6d272 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:29.177627 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-82637e6e-8847-41f7-8c00-5f8b95e6d272 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:29.181345 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-82637e6e-8847-41f7-8c00-5f8b95e6d272 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:29.183557 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-82637e6e-8847-41f7-8c00-5f8b95e6d272 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:29.190158 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-82637e6e-8847-41f7-8c00-5f8b95e6d272 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:29.222434 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5a363d39-dd9b-48dc-92f1-3a5c2b31960a tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46cf7ae501740869d677d0e9e007041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a7b6a5dc86486682777285fa3295ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:29.292846 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5a363d39-dd9b-48dc-92f1-3a5c2b31960a tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] 10.222.0.26 "GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9" status: 200 len: 1267 microversion: 2.1 time: 0.731517 Sep 12 23:53:29.294684 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 17/28] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:53:28 2022] GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9 => generated 1267 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:53:29.318170 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-82637e6e-8847-41f7-8c00-5f8b95e6d272 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Getting quotas for project 6c458cf41ded4113a09fb07e10d81d39. Resources: {'instances', 'cores', 'ram'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 23:53:29.329096 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-82637e6e-8847-41f7-8c00-5f8b95e6d272 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Getting quotas for user 76eb39c2010e43aaa0a01caaea3a38b9 and project 6c458cf41ded4113a09fb07e10d81d39. Resources: {'instances', 'cores', 'ram'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 23:53:29.381612 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-82637e6e-8847-41f7-8c00-5f8b95e6d272 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Going to run 1 instances... {{(pid=126976) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 23:53:29.389014 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-82637e6e-8847-41f7-8c00-5f8b95e6d272 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: f3ba81ef-4875-4ba4-94e0-c8275bfcf252] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='22a47167-5e04-441a-a504-d76d82afc776',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126976) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 23:53:29.598111 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-82637e6e-8847-41f7-8c00-5f8b95e6d272 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.125922 Sep 12 23:53:29.605094 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 12/29] 10.222.0.26 () {60 vars in 1147 bytes} [Mon Sep 12 23:53:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 4137 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 12 23:53:29.623557 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-cbd7d3a3-e96a-4c1d-bb20-6c8789e4b210 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:29.626095 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-cbd7d3a3-e96a-4c1d-bb20-6c8789e4b210 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: f3ba81ef-4875-4ba4-94e0-c8275bfcf252] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:53:30.342538 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-68d362ed-36b9-461a-834c-d104e7fdd0b5 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:30.343339 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-68d362ed-36b9-461a-834c-d104e7fdd0b5 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] [instance: cab7089c-6860-4148-9dd6-45939ee2c1a9] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:53:30.365090 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-68d362ed-36b9-461a-834c-d104e7fdd0b5 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:30.368784 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-68d362ed-36b9-461a-834c-d104e7fdd0b5 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:30.369447 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-68d362ed-36b9-461a-834c-d104e7fdd0b5 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:30.375402 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-68d362ed-36b9-461a-834c-d104e7fdd0b5 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:30.376312 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-68d362ed-36b9-461a-834c-d104e7fdd0b5 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:30.381538 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-68d362ed-36b9-461a-834c-d104e7fdd0b5 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:30.636472 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-cbd7d3a3-e96a-4c1d-bb20-6c8789e4b210 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:30.711465 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-cbd7d3a3-e96a-4c1d-bb20-6c8789e4b210 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252" status: 200 len: 1221 microversion: 2.1 time: 1.087124 Sep 12 23:53:30.723355 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 18/30] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:53:29 2022] GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252 => generated 1221 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:53:31.772472 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-815fa2c3-4533-4be1-80fa-29aab6cf744f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:31.797870 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-815fa2c3-4533-4be1-80fa-29aab6cf744f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: f3ba81ef-4875-4ba4-94e0-c8275bfcf252] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:53:31.827161 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-815fa2c3-4533-4be1-80fa-29aab6cf744f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:31.830640 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-815fa2c3-4533-4be1-80fa-29aab6cf744f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:31.833105 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-815fa2c3-4533-4be1-80fa-29aab6cf744f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:31.835293 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-815fa2c3-4533-4be1-80fa-29aab6cf744f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:31.843133 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-815fa2c3-4533-4be1-80fa-29aab6cf744f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:31.844216 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-815fa2c3-4533-4be1-80fa-29aab6cf744f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:32.106409 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell0:SELECT=2 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:32.477151 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-68d362ed-36b9-461a-834c-d104e7fdd0b5 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46cf7ae501740869d677d0e9e007041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a7b6a5dc86486682777285fa3295ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:32.565625 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-68d362ed-36b9-461a-834c-d104e7fdd0b5 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] 10.222.0.26 "GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9" status: 200 len: 1273 microversion: 2.1 time: 2.228920 Sep 12 23:53:32.567240 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 13/31] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:53:30 2022] GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9 => generated 1273 bytes in 2231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:53:33.094434 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-815fa2c3-4533-4be1-80fa-29aab6cf744f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:33.132386 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-815fa2c3-4533-4be1-80fa-29aab6cf744f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252" status: 200 len: 1217 microversion: 2.1 time: 1.368863 Sep 12 23:53:33.134381 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 19/32] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:53:31 2022] GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252 => generated 1217 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:53:33.623924 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-173e56ae-d2da-428f-b912-2816e80b6ef5 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:33.632165 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-173e56ae-d2da-428f-b912-2816e80b6ef5 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] [instance: cab7089c-6860-4148-9dd6-45939ee2c1a9] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:53:33.655501 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-173e56ae-d2da-428f-b912-2816e80b6ef5 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:33.665882 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-173e56ae-d2da-428f-b912-2816e80b6ef5 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:33.668291 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-173e56ae-d2da-428f-b912-2816e80b6ef5 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:33.677141 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-173e56ae-d2da-428f-b912-2816e80b6ef5 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:33.681415 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-173e56ae-d2da-428f-b912-2816e80b6ef5 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:33.682866 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-173e56ae-d2da-428f-b912-2816e80b6ef5 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:34.183031 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-cf70949c-d04e-4eb8-884b-4cf24e974072 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:34.192499 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-cf70949c-d04e-4eb8-884b-4cf24e974072 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: f3ba81ef-4875-4ba4-94e0-c8275bfcf252] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:53:34.212385 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cf70949c-d04e-4eb8-884b-4cf24e974072 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:34.222959 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cf70949c-d04e-4eb8-884b-4cf24e974072 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:34.224467 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cf70949c-d04e-4eb8-884b-4cf24e974072 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:34.226137 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cf70949c-d04e-4eb8-884b-4cf24e974072 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:34.227470 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cf70949c-d04e-4eb8-884b-4cf24e974072 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:34.228533 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cf70949c-d04e-4eb8-884b-4cf24e974072 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:34.753540 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-cf70949c-d04e-4eb8-884b-4cf24e974072 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:34.809878 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-173e56ae-d2da-428f-b912-2816e80b6ef5 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46cf7ae501740869d677d0e9e007041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a7b6a5dc86486682777285fa3295ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:34.834429 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-cf70949c-d04e-4eb8-884b-4cf24e974072 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252" status: 200 len: 1279 microversion: 2.1 time: 0.658751 Sep 12 23:53:34.846228 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 20/33] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:53:34 2022] GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252 => generated 1279 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:53:34.857504 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-173e56ae-d2da-428f-b912-2816e80b6ef5 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] 10.222.0.26 "GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9" status: 200 len: 1273 microversion: 2.1 time: 1.245509 Sep 12 23:53:34.867702 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 14/34] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:53:33 2022] GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9 => generated 1273 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:53:35.897300 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e2a53cee-0f95-4b01-b1fd-453fd301e932 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:35.898306 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e2a53cee-0f95-4b01-b1fd-453fd301e932 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: f3ba81ef-4875-4ba4-94e0-c8275bfcf252] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:53:35.903793 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e045cf5f-cbc4-433d-97ca-fd261bebda45 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:35.909066 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e045cf5f-cbc4-433d-97ca-fd261bebda45 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] [instance: cab7089c-6860-4148-9dd6-45939ee2c1a9] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:53:35.945375 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e2a53cee-0f95-4b01-b1fd-453fd301e932 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:35.946229 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e2a53cee-0f95-4b01-b1fd-453fd301e932 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:35.947012 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e2a53cee-0f95-4b01-b1fd-453fd301e932 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:35.953083 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e045cf5f-cbc4-433d-97ca-fd261bebda45 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:35.953985 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e045cf5f-cbc4-433d-97ca-fd261bebda45 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:35.962019 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e045cf5f-cbc4-433d-97ca-fd261bebda45 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:35.963470 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e045cf5f-cbc4-433d-97ca-fd261bebda45 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:35.964258 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e045cf5f-cbc4-433d-97ca-fd261bebda45 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:35.964968 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e045cf5f-cbc4-433d-97ca-fd261bebda45 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:35.971136 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e2a53cee-0f95-4b01-b1fd-453fd301e932 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:35.972050 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e2a53cee-0f95-4b01-b1fd-453fd301e932 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:35.972799 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e2a53cee-0f95-4b01-b1fd-453fd301e932 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:37.128158 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e2a53cee-0f95-4b01-b1fd-453fd301e932 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:37.154353 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e2a53cee-0f95-4b01-b1fd-453fd301e932 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252" status: 200 len: 1279 microversion: 2.1 time: 1.273592 Sep 12 23:53:37.163501 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 21/35] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:53:35 2022] GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252 => generated 1279 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:53:37.954083 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e045cf5f-cbc4-433d-97ca-fd261bebda45 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46cf7ae501740869d677d0e9e007041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a7b6a5dc86486682777285fa3295ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:38.027791 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e045cf5f-cbc4-433d-97ca-fd261bebda45 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] 10.222.0.26 "GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9" status: 200 len: 1273 microversion: 2.1 time: 2.104485 Sep 12 23:53:38.033318 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 15/36] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:53:35 2022] GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9 => generated 1273 bytes in 2144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:53:38.189508 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2ebe0f11-a599-4410-a0ea-40263d787e7a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:38.210749 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2ebe0f11-a599-4410-a0ea-40263d787e7a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: f3ba81ef-4875-4ba4-94e0-c8275bfcf252] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:53:38.252478 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2ebe0f11-a599-4410-a0ea-40263d787e7a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:38.253407 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2ebe0f11-a599-4410-a0ea-40263d787e7a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:38.254244 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2ebe0f11-a599-4410-a0ea-40263d787e7a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:38.265924 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2ebe0f11-a599-4410-a0ea-40263d787e7a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:38.266904 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2ebe0f11-a599-4410-a0ea-40263d787e7a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:38.267717 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2ebe0f11-a599-4410-a0ea-40263d787e7a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:39.095999 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-dd5af4bb-9211-4c8e-be80-7676edefda7f tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:39.098111 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-dd5af4bb-9211-4c8e-be80-7676edefda7f tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] [instance: cab7089c-6860-4148-9dd6-45939ee2c1a9] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:53:39.122957 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dd5af4bb-9211-4c8e-be80-7676edefda7f tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:39.124463 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dd5af4bb-9211-4c8e-be80-7676edefda7f tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:39.125518 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dd5af4bb-9211-4c8e-be80-7676edefda7f tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:39.127052 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dd5af4bb-9211-4c8e-be80-7676edefda7f tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:39.128161 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dd5af4bb-9211-4c8e-be80-7676edefda7f tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:39.129128 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dd5af4bb-9211-4c8e-be80-7676edefda7f tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:39.253328 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2ebe0f11-a599-4410-a0ea-40263d787e7a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:39.277814 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell0:SELECT=4 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:39.324934 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2ebe0f11-a599-4410-a0ea-40263d787e7a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252" status: 200 len: 1279 microversion: 2.1 time: 1.139377 Sep 12 23:53:39.335743 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 22/37] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:53:38 2022] GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252 => generated 1279 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:53:39.364043 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell0:SELECT=16 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:39.624108 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-dd5af4bb-9211-4c8e-be80-7676edefda7f tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46cf7ae501740869d677d0e9e007041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a7b6a5dc86486682777285fa3295ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:39.656959 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-dd5af4bb-9211-4c8e-be80-7676edefda7f tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] 10.222.0.26 "GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9" status: 200 len: 1273 microversion: 2.1 time: 0.603443 Sep 12 23:53:39.659486 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 16/38] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:53:39 2022] GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9 => generated 1273 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:53:40.391804 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a68cfa35-04d2-46c3-8eff-057cad61b095 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:40.394678 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a68cfa35-04d2-46c3-8eff-057cad61b095 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: f3ba81ef-4875-4ba4-94e0-c8275bfcf252] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:53:40.435821 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a68cfa35-04d2-46c3-8eff-057cad61b095 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:40.437104 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a68cfa35-04d2-46c3-8eff-057cad61b095 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:40.438126 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a68cfa35-04d2-46c3-8eff-057cad61b095 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:40.440292 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a68cfa35-04d2-46c3-8eff-057cad61b095 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:40.441323 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a68cfa35-04d2-46c3-8eff-057cad61b095 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:40.442541 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a68cfa35-04d2-46c3-8eff-057cad61b095 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:40.689419 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5737efb9-5836-4415-abb4-90c29ffa50b8 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:40.691665 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5737efb9-5836-4415-abb4-90c29ffa50b8 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] [instance: cab7089c-6860-4148-9dd6-45939ee2c1a9] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:53:40.694886 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell0:SELECT=20 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:40.766886 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5737efb9-5836-4415-abb4-90c29ffa50b8 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:40.789180 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5737efb9-5836-4415-abb4-90c29ffa50b8 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:40.805210 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5737efb9-5836-4415-abb4-90c29ffa50b8 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:40.813276 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5737efb9-5836-4415-abb4-90c29ffa50b8 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:40.817708 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5737efb9-5836-4415-abb4-90c29ffa50b8 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:40.827244 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5737efb9-5836-4415-abb4-90c29ffa50b8 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:41.389827 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a68cfa35-04d2-46c3-8eff-057cad61b095 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:41.399056 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a68cfa35-04d2-46c3-8eff-057cad61b095 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252" status: 200 len: 1279 microversion: 2.1 time: 1.020729 Sep 12 23:53:41.407117 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 23/39] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:53:40 2022] GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252 => generated 1279 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:53:41.413501 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2fcb412e-1c1a-4d38-95e4-2b0ddba06108 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1671192832", "imageRef": "22a47167-5e04-441a-a504-d76d82afc776", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3c1b7b6d-23b0-4d33-9526-13eb374ddc8c"}], "security_groups": [{"name": "tempest-securitygroup--2071086310"}], "key_name": "tempest-keypair-43140354", "user_data": "}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:53:42.096597 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.network.neutron [None req-2fcb412e-1c1a-4d38-95e4-2b0ddba06108 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] validate_networks() for [('3c1b7b6d-23b0-4d33-9526-13eb374ddc8c', None, None, None, None, None)] {{(pid=126975) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 23:53:42.263068 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-5737efb9-5836-4415-abb4-90c29ffa50b8 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46cf7ae501740869d677d0e9e007041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a7b6a5dc86486682777285fa3295ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:42.284382 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5737efb9-5836-4415-abb4-90c29ffa50b8 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] 10.222.0.26 "GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9" status: 200 len: 1315 microversion: 2.1 time: 1.601919 Sep 12 23:53:42.295046 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 17/40] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:53:40 2022] GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9 => generated 1315 bytes in 1604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:53:42.434743 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-14b2a00e-971e-422f-822b-631779577e91 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:42.435439 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-14b2a00e-971e-422f-822b-631779577e91 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: f3ba81ef-4875-4ba4-94e0-c8275bfcf252] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:53:42.446837 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-14b2a00e-971e-422f-822b-631779577e91 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:42.447516 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-14b2a00e-971e-422f-822b-631779577e91 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:42.447995 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-14b2a00e-971e-422f-822b-631779577e91 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:42.448816 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-14b2a00e-971e-422f-822b-631779577e91 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:42.449287 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-14b2a00e-971e-422f-822b-631779577e91 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:42.449721 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-14b2a00e-971e-422f-822b-631779577e91 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:43.287630 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-14b2a00e-971e-422f-822b-631779577e91 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:43.315425 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-14b2a00e-971e-422f-822b-631779577e91 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252" status: 200 len: 1321 microversion: 2.1 time: 0.880623 Sep 12 23:53:43.316485 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 18/41] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:53:42 2022] GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252 => generated 1321 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:53:43.341043 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-00bb1a0b-ad7a-45c6-addc-a7e39b87686c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1316248471", "imageRef": "22a47167-5e04-441a-a504-d76d82afc776", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "44934c4b-e07a-4c1a-9ac8-ec89467058c7"}], "security_groups": [{"name": "tempest-securitygroup--1255463120"}], "key_name": "tempest-keypair-1902538849", "user_data": "}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:53:43.694486 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-2fcb412e-1c1a-4d38-95e4-2b0ddba06108 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Flavor limits 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 23:53:43.695148 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-2fcb412e-1c1a-4d38-95e4-2b0ddba06108 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Image limits 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 23:53:43.695506 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-2fcb412e-1c1a-4d38-95e4-2b0ddba06108 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Flavor pref 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 23:53:43.695930 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-2fcb412e-1c1a-4d38-95e4-2b0ddba06108 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Image pref 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 23:53:43.696399 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-2fcb412e-1c1a-4d38-95e4-2b0ddba06108 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 23:53:43.720372 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2fcb412e-1c1a-4d38-95e4-2b0ddba06108 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:43.733122 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2fcb412e-1c1a-4d38-95e4-2b0ddba06108 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:43.733805 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2fcb412e-1c1a-4d38-95e4-2b0ddba06108 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:43.735060 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2fcb412e-1c1a-4d38-95e4-2b0ddba06108 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:43.736210 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2fcb412e-1c1a-4d38-95e4-2b0ddba06108 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:43.736892 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2fcb412e-1c1a-4d38-95e4-2b0ddba06108 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:43.764742 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-2fcb412e-1c1a-4d38-95e4-2b0ddba06108 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Getting quotas for project 6c681f1232de4a5fbfc728c230f80624. Resources: {'instances', 'cores', 'ram'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 23:53:43.775550 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.network.neutron [None req-00bb1a0b-ad7a-45c6-addc-a7e39b87686c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] validate_networks() for [('44934c4b-e07a-4c1a-9ac8-ec89467058c7', None, None, None, None, None)] {{(pid=126976) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 23:53:43.783175 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-2fcb412e-1c1a-4d38-95e4-2b0ddba06108 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Getting quotas for user a8cbfc74644f4d4594a70b833ad7002c and project 6c681f1232de4a5fbfc728c230f80624. Resources: {'instances', 'cores', 'ram'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 23:53:43.802120 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2fcb412e-1c1a-4d38-95e4-2b0ddba06108 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Going to run 1 instances... {{(pid=126975) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 23:53:43.806567 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2fcb412e-1c1a-4d38-95e4-2b0ddba06108 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: 1bdd77eb-4b69-4630-9f49-a1d317bb1e12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='22a47167-5e04-441a-a504-d76d82afc776',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126975) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 23:53:43.917980 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2fcb412e-1c1a-4d38-95e4-2b0ddba06108 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.508668 Sep 12 23:53:43.920983 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 24/42] 10.222.0.26 () {60 vars in 1147 bytes} [Mon Sep 12 23:53:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 2513 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 12 23:53:43.930221 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2e20f6ea-82b4-401b-a91d-668fdb37916c tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:43.931761 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2e20f6ea-82b4-401b-a91d-668fdb37916c tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] [instance: cab7089c-6860-4148-9dd6-45939ee2c1a9] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:53:43.943848 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2e20f6ea-82b4-401b-a91d-668fdb37916c tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:43.946256 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2e20f6ea-82b4-401b-a91d-668fdb37916c tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:43.947675 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2e20f6ea-82b4-401b-a91d-668fdb37916c tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:43.949215 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2e20f6ea-82b4-401b-a91d-668fdb37916c tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:43.950032 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2e20f6ea-82b4-401b-a91d-668fdb37916c tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:43.951272 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2e20f6ea-82b4-401b-a91d-668fdb37916c tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:44.509134 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2e20f6ea-82b4-401b-a91d-668fdb37916c tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46cf7ae501740869d677d0e9e007041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a7b6a5dc86486682777285fa3295ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:44.519167 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2e20f6ea-82b4-401b-a91d-668fdb37916c tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] 10.222.0.26 "GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9" status: 200 len: 1315 microversion: 2.1 time: 0.596272 Sep 12 23:53:44.520231 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 25/43] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:53:43 2022] GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9 => generated 1315 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:53:44.541069 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-41f126d7-daa0-4f9c-9f04-9af4fc9842b8 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:44.547479 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-41f126d7-daa0-4f9c-9f04-9af4fc9842b8 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: 1bdd77eb-4b69-4630-9f49-a1d317bb1e12] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:53:44.719139 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-41f126d7-daa0-4f9c-9f04-9af4fc9842b8 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:44.740280 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-41f126d7-daa0-4f9c-9f04-9af4fc9842b8 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12" status: 200 len: 1240 microversion: 2.1 time: 0.217542 Sep 12 23:53:44.768803 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 26/44] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:53:44 2022] GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12 => generated 1240 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:53:44.785735 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5dbaa079-d161-44f8-8e34-2c00bdc58adc tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:44.788304 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5dbaa079-d161-44f8-8e34-2c00bdc58adc tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: f3ba81ef-4875-4ba4-94e0-c8275bfcf252] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:53:44.801843 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5dbaa079-d161-44f8-8e34-2c00bdc58adc tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:44.803548 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5dbaa079-d161-44f8-8e34-2c00bdc58adc tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:44.805500 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5dbaa079-d161-44f8-8e34-2c00bdc58adc tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:44.814790 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5dbaa079-d161-44f8-8e34-2c00bdc58adc tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:44.816351 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5dbaa079-d161-44f8-8e34-2c00bdc58adc tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:44.818996 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5dbaa079-d161-44f8-8e34-2c00bdc58adc tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:45.239726 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-00bb1a0b-ad7a-45c6-addc-a7e39b87686c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Flavor limits 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 23:53:45.240611 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-00bb1a0b-ad7a-45c6-addc-a7e39b87686c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Image limits 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 23:53:45.240789 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-00bb1a0b-ad7a-45c6-addc-a7e39b87686c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Flavor pref 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 23:53:45.241227 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-00bb1a0b-ad7a-45c6-addc-a7e39b87686c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Image pref 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 23:53:45.241737 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-00bb1a0b-ad7a-45c6-addc-a7e39b87686c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 23:53:45.258798 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-00bb1a0b-ad7a-45c6-addc-a7e39b87686c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:45.259334 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-00bb1a0b-ad7a-45c6-addc-a7e39b87686c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:45.259776 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-00bb1a0b-ad7a-45c6-addc-a7e39b87686c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:45.260549 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-00bb1a0b-ad7a-45c6-addc-a7e39b87686c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:45.261016 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-00bb1a0b-ad7a-45c6-addc-a7e39b87686c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:45.261435 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-00bb1a0b-ad7a-45c6-addc-a7e39b87686c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:45.288797 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-00bb1a0b-ad7a-45c6-addc-a7e39b87686c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Getting quotas for project 6b2f385a651c408bb9d32b5c4e1ab6ff. Resources: {'instances', 'cores', 'ram'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 23:53:45.296252 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-00bb1a0b-ad7a-45c6-addc-a7e39b87686c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Getting quotas for user 296f02c73fc548969bf60df4f8f372b0 and project 6b2f385a651c408bb9d32b5c4e1ab6ff. Resources: {'instances', 'cores', 'ram'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 23:53:45.322368 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-00bb1a0b-ad7a-45c6-addc-a7e39b87686c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Going to run 1 instances... {{(pid=126976) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 23:53:45.325478 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-00bb1a0b-ad7a-45c6-addc-a7e39b87686c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='22a47167-5e04-441a-a504-d76d82afc776',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126976) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 23:53:45.495103 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5dbaa079-d161-44f8-8e34-2c00bdc58adc tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:45.509779 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5dbaa079-d161-44f8-8e34-2c00bdc58adc tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252" status: 200 len: 1321 microversion: 2.1 time: 0.738994 Sep 12 23:53:45.523683 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-00bb1a0b-ad7a-45c6-addc-a7e39b87686c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.200497 Sep 12 23:53:45.523683 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 19/45] 10.222.0.26 () {62 vars in 1188 bytes} [Mon Sep 12 23:53:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 2204 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 12 23:53:45.533881 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 27/46] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:53:44 2022] GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252 => generated 1321 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:53:45.545475 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2a240734-787e-446c-890a-d061141cd397 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:45.547516 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2a240734-787e-446c-890a-d061141cd397 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:53:45.569981 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-efd39aae-702c-4b05-a485-9bd036e221e1 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:45.571533 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-efd39aae-702c-4b05-a485-9bd036e221e1 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] [instance: cab7089c-6860-4148-9dd6-45939ee2c1a9] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:53:45.610328 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-efd39aae-702c-4b05-a485-9bd036e221e1 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:45.610881 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-efd39aae-702c-4b05-a485-9bd036e221e1 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:45.617745 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-efd39aae-702c-4b05-a485-9bd036e221e1 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:45.621836 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-efd39aae-702c-4b05-a485-9bd036e221e1 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:45.624308 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-efd39aae-702c-4b05-a485-9bd036e221e1 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:45.624787 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-efd39aae-702c-4b05-a485-9bd036e221e1 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:45.727419 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2a240734-787e-446c-890a-d061141cd397 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:45.749512 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2a240734-787e-446c-890a-d061141cd397 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:45.753130 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2a240734-787e-446c-890a-d061141cd397 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:45.758302 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2a240734-787e-446c-890a-d061141cd397 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1282 microversion: 2.20 time: 0.222597 Sep 12 23:53:45.759886 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 20/47] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:53:45 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1282 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 23:53:45.826226 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3d637371-0af2-4286-9cee-604e13726312 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:45.831200 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3d637371-0af2-4286-9cee-604e13726312 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: 1bdd77eb-4b69-4630-9f49-a1d317bb1e12] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:53:45.874495 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3d637371-0af2-4286-9cee-604e13726312 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:45.875594 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3d637371-0af2-4286-9cee-604e13726312 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:45.876520 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3d637371-0af2-4286-9cee-604e13726312 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:45.878033 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3d637371-0af2-4286-9cee-604e13726312 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:45.879038 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3d637371-0af2-4286-9cee-604e13726312 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:45.887544 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3d637371-0af2-4286-9cee-604e13726312 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:45.977848 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-efd39aae-702c-4b05-a485-9bd036e221e1 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46cf7ae501740869d677d0e9e007041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a7b6a5dc86486682777285fa3295ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:46.032497 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-efd39aae-702c-4b05-a485-9bd036e221e1 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] 10.222.0.26 "GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9" status: 200 len: 1315 microversion: 2.1 time: 0.484167 Sep 12 23:53:46.039162 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 28/48] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:53:45 2022] GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9 => generated 1315 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:53:46.216857 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3d637371-0af2-4286-9cee-604e13726312 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:46.250324 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3d637371-0af2-4286-9cee-604e13726312 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12" status: 200 len: 1244 microversion: 2.1 time: 0.447296 Sep 12 23:53:46.260022 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 21/49] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:53:45 2022] GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12 => generated 1244 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:53:46.564712 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e4e539cc-d190-4d34-8e5a-aeb6afc7c688 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:46.565920 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e4e539cc-d190-4d34-8e5a-aeb6afc7c688 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: f3ba81ef-4875-4ba4-94e0-c8275bfcf252] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:53:46.579146 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=8 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:46.606928 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e4e539cc-d190-4d34-8e5a-aeb6afc7c688 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:46.611028 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e4e539cc-d190-4d34-8e5a-aeb6afc7c688 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:46.616940 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e4e539cc-d190-4d34-8e5a-aeb6afc7c688 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:46.620925 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e4e539cc-d190-4d34-8e5a-aeb6afc7c688 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:46.625016 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e4e539cc-d190-4d34-8e5a-aeb6afc7c688 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:46.626368 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e4e539cc-d190-4d34-8e5a-aeb6afc7c688 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:46.635050 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=59 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:46.807707 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2902eda8-bf2a-42fb-a6d1-50991e827090 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:46.808420 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2902eda8-bf2a-42fb-a6d1-50991e827090 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:53:46.997425 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2902eda8-bf2a-42fb-a6d1-50991e827090 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:47.013959 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2902eda8-bf2a-42fb-a6d1-50991e827090 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:47.015611 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2902eda8-bf2a-42fb-a6d1-50991e827090 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:47.016814 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2902eda8-bf2a-42fb-a6d1-50991e827090 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1282 microversion: 2.20 time: 0.214305 Sep 12 23:53:47.017449 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 22/50] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:53:46 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1282 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 23:53:47.068821 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-72dfe979-e3be-4826-b312-4a5f0f9fec70 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:47.069871 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-72dfe979-e3be-4826-b312-4a5f0f9fec70 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] [instance: cab7089c-6860-4148-9dd6-45939ee2c1a9] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:53:47.087769 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-72dfe979-e3be-4826-b312-4a5f0f9fec70 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:47.088675 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-72dfe979-e3be-4826-b312-4a5f0f9fec70 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:47.089379 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-72dfe979-e3be-4826-b312-4a5f0f9fec70 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:47.090297 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-72dfe979-e3be-4826-b312-4a5f0f9fec70 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:47.095868 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-72dfe979-e3be-4826-b312-4a5f0f9fec70 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:47.096651 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-72dfe979-e3be-4826-b312-4a5f0f9fec70 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:47.564699 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e4e539cc-d190-4d34-8e5a-aeb6afc7c688 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:47.590598 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e4e539cc-d190-4d34-8e5a-aeb6afc7c688 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252" status: 200 len: 1321 microversion: 2.1 time: 1.032761 Sep 12 23:53:47.607259 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 29/51] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:53:46 2022] GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252 => generated 1321 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:53:47.607259 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-29ed6f43-269f-4832-b4c1-c2887c644eaf tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:47.607259 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-29ed6f43-269f-4832-b4c1-c2887c644eaf tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: 1bdd77eb-4b69-4630-9f49-a1d317bb1e12] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:53:47.644042 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-29ed6f43-269f-4832-b4c1-c2887c644eaf tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:47.644042 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-29ed6f43-269f-4832-b4c1-c2887c644eaf tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:47.644368 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-29ed6f43-269f-4832-b4c1-c2887c644eaf tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:47.655708 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-29ed6f43-269f-4832-b4c1-c2887c644eaf tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:47.658063 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-29ed6f43-269f-4832-b4c1-c2887c644eaf tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:47.659534 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-29ed6f43-269f-4832-b4c1-c2887c644eaf tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:48.023180 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-29ed6f43-269f-4832-b4c1-c2887c644eaf tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:48.046048 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-29ed6f43-269f-4832-b4c1-c2887c644eaf tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12" status: 200 len: 1236 microversion: 2.1 time: 0.450063 Sep 12 23:53:48.053076 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-72dfe979-e3be-4826-b312-4a5f0f9fec70 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46cf7ae501740869d677d0e9e007041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a7b6a5dc86486682777285fa3295ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:48.066957 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 30/52] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:53:47 2022] GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12 => generated 1236 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:53:48.069886 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-72dfe979-e3be-4826-b312-4a5f0f9fec70 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] 10.222.0.26 "GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9" status: 200 len: 1315 microversion: 2.1 time: 1.005994 Sep 12 23:53:48.088769 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4cf0a6a3-da2c-40ac-8f5f-8b83647645ab tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:48.090031 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 23/53] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:53:47 2022] GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9 => generated 1315 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:53:48.091254 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4cf0a6a3-da2c-40ac-8f5f-8b83647645ab tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:53:48.109463 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4cf0a6a3-da2c-40ac-8f5f-8b83647645ab tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:48.110365 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4cf0a6a3-da2c-40ac-8f5f-8b83647645ab tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:48.113433 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4cf0a6a3-da2c-40ac-8f5f-8b83647645ab tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:48.119742 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4cf0a6a3-da2c-40ac-8f5f-8b83647645ab tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:48.120829 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4cf0a6a3-da2c-40ac-8f5f-8b83647645ab tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:48.121463 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4cf0a6a3-da2c-40ac-8f5f-8b83647645ab tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:48.422358 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4cf0a6a3-da2c-40ac-8f5f-8b83647645ab tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:48.434887 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4cf0a6a3-da2c-40ac-8f5f-8b83647645ab tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:48.437043 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4cf0a6a3-da2c-40ac-8f5f-8b83647645ab tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:48.438285 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4cf0a6a3-da2c-40ac-8f5f-8b83647645ab tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1286 microversion: 2.20 time: 0.357834 Sep 12 23:53:48.450200 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 31/54] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:53:48 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1286 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:53:48.652567 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3be7bafa-636b-423f-8eda-9973ced7c502 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:48.658958 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3be7bafa-636b-423f-8eda-9973ced7c502 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: f3ba81ef-4875-4ba4-94e0-c8275bfcf252] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:53:48.723468 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3be7bafa-636b-423f-8eda-9973ced7c502 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:48.725086 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3be7bafa-636b-423f-8eda-9973ced7c502 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:48.726370 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3be7bafa-636b-423f-8eda-9973ced7c502 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:48.728686 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3be7bafa-636b-423f-8eda-9973ced7c502 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:48.729948 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3be7bafa-636b-423f-8eda-9973ced7c502 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:48.731008 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3be7bafa-636b-423f-8eda-9973ced7c502 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:49.110372 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-72998586-8bc2-498c-bf94-27e32467ef2b tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:49.114337 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-72998586-8bc2-498c-bf94-27e32467ef2b tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: 1bdd77eb-4b69-4630-9f49-a1d317bb1e12] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:53:49.129751 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-72998586-8bc2-498c-bf94-27e32467ef2b tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:49.131274 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-72998586-8bc2-498c-bf94-27e32467ef2b tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:49.132645 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-72998586-8bc2-498c-bf94-27e32467ef2b tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:49.134565 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-72998586-8bc2-498c-bf94-27e32467ef2b tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:49.135999 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-72998586-8bc2-498c-bf94-27e32467ef2b tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:49.137872 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-72998586-8bc2-498c-bf94-27e32467ef2b tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:49.419767 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-72998586-8bc2-498c-bf94-27e32467ef2b tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:49.449553 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-72998586-8bc2-498c-bf94-27e32467ef2b tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12" status: 200 len: 1292 microversion: 2.1 time: 0.356998 Sep 12 23:53:49.451055 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 32/55] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:53:49 2022] GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12 => generated 1292 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:53:49.474804 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f064e7bc-778d-4bcf-9cfa-5ce5ed965902 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:49.478259 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f064e7bc-778d-4bcf-9cfa-5ce5ed965902 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] [instance: cab7089c-6860-4148-9dd6-45939ee2c1a9] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:53:49.509394 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f064e7bc-778d-4bcf-9cfa-5ce5ed965902 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:49.510129 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f064e7bc-778d-4bcf-9cfa-5ce5ed965902 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:49.510391 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f064e7bc-778d-4bcf-9cfa-5ce5ed965902 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:49.516367 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f064e7bc-778d-4bcf-9cfa-5ce5ed965902 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:49.518311 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f064e7bc-778d-4bcf-9cfa-5ce5ed965902 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:49.518777 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f064e7bc-778d-4bcf-9cfa-5ce5ed965902 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:49.766432 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3be7bafa-636b-423f-8eda-9973ced7c502 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:49.771764 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=59 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:49.824044 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3be7bafa-636b-423f-8eda-9973ced7c502 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252" status: 200 len: 1321 microversion: 2.1 time: 1.176099 Sep 12 23:53:49.841456 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 24/56] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:53:48 2022] GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252 => generated 1321 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:53:49.878784 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d4678338-d45a-4626-be0b-716059c60044 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:49.886348 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d4678338-d45a-4626-be0b-716059c60044 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:53:49.907441 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=9 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:49.915250 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d4678338-d45a-4626-be0b-716059c60044 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:49.920048 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d4678338-d45a-4626-be0b-716059c60044 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:49.923073 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d4678338-d45a-4626-be0b-716059c60044 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:49.924701 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d4678338-d45a-4626-be0b-716059c60044 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:49.930109 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d4678338-d45a-4626-be0b-716059c60044 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:49.931748 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d4678338-d45a-4626-be0b-716059c60044 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:50.638201 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d4678338-d45a-4626-be0b-716059c60044 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:50.684307 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d4678338-d45a-4626-be0b-716059c60044 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:50.696399 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d4678338-d45a-4626-be0b-716059c60044 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:50.706171 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d4678338-d45a-4626-be0b-716059c60044 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1278 microversion: 2.20 time: 0.874574 Sep 12 23:53:50.742443 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 25/57] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:53:49 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1278 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:53:51.476813 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-07ac0418-636f-44b2-9313-48ccafab7a78 req-48adfce4-d6ce-449f-a780-d0de1bfb06fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3ba81ef-4875-4ba4-94e0-c8275bfcf252", "tag": "b826088f-8d82-4b72-a304-bc22a8977946"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:53:51.492600 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-07ac0418-636f-44b2-9313-48ccafab7a78 req-48adfce4-d6ce-449f-a780-d0de1bfb06fc service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:51.493096 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-07ac0418-636f-44b2-9313-48ccafab7a78 req-48adfce4-d6ce-449f-a780-d0de1bfb06fc service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:51.493538 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-07ac0418-636f-44b2-9313-48ccafab7a78 req-48adfce4-d6ce-449f-a780-d0de1bfb06fc service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:51.520939 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-07ac0418-636f-44b2-9313-48ccafab7a78 req-48adfce4-d6ce-449f-a780-d0de1bfb06fc service nova] Creating event network-changed:b826088f-8d82-4b72-a304-bc22a8977946 for instance f3ba81ef-4875-4ba4-94e0-c8275bfcf252 on hv-cinder-82002 Sep 12 23:53:51.521469 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-07ac0418-636f-44b2-9313-48ccafab7a78 req-48adfce4-d6ce-449f-a780-d0de1bfb06fc service nova] Acquiring lock "compute-rpcapi-router" {{(pid=126976) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 12 23:53:51.523629 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-07ac0418-636f-44b2-9313-48ccafab7a78 req-48adfce4-d6ce-449f-a780-d0de1bfb06fc service nova] Acquired lock "compute-rpcapi-router" {{(pid=126976) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 12 23:53:51.525381 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-24d452e1-5f66-424c-ab1c-edd4bef65ac2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:51.526045 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-24d452e1-5f66-424c-ab1c-edd4bef65ac2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:51.526960 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-24d452e1-5f66-424c-ab1c-edd4bef65ac2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:51.527961 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-24d452e1-5f66-424c-ab1c-edd4bef65ac2 None None] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:51.528630 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-24d452e1-5f66-424c-ab1c-edd4bef65ac2 None None] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:51.529910 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-24d452e1-5f66-424c-ab1c-edd4bef65ac2 None None] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:51.573836 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.compute.rpcapi [None req-24d452e1-5f66-424c-ab1c-edd4bef65ac2 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 12 23:53:51.579901 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-24d452e1-5f66-424c-ab1c-edd4bef65ac2 None None] Releasing lock "compute-rpcapi-router" {{(pid=126976) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 12 23:53:51.616210 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-24d452e1-5f66-424c-ab1c-edd4bef65ac2 None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.842812 Sep 12 23:53:51.617490 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 26/58] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:53:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:53:51.633146 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-08e5a69e-7230-4512-9f5d-894b928efc93 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:51.634489 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-08e5a69e-7230-4512-9f5d-894b928efc93 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: 1bdd77eb-4b69-4630-9f49-a1d317bb1e12] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:53:51.647759 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-08e5a69e-7230-4512-9f5d-894b928efc93 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:51.648540 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-08e5a69e-7230-4512-9f5d-894b928efc93 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:51.649280 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-08e5a69e-7230-4512-9f5d-894b928efc93 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:51.650724 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-08e5a69e-7230-4512-9f5d-894b928efc93 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:51.651836 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-08e5a69e-7230-4512-9f5d-894b928efc93 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:51.652597 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-08e5a69e-7230-4512-9f5d-894b928efc93 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:51.790678 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f064e7bc-778d-4bcf-9cfa-5ce5ed965902 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46cf7ae501740869d677d0e9e007041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a7b6a5dc86486682777285fa3295ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:51.800571 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f064e7bc-778d-4bcf-9cfa-5ce5ed965902 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] 10.222.0.26 "GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9" status: 200 len: 1315 microversion: 2.1 time: 2.347876 Sep 12 23:53:51.801358 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 33/59] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:53:49 2022] GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9 => generated 1315 bytes in 2350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:53:51.815738 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-08e5a69e-7230-4512-9f5d-894b928efc93 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:51.819734 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e7ab0682-5e8b-4505-b565-dac4a5105213 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:51.820371 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e7ab0682-5e8b-4505-b565-dac4a5105213 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: f3ba81ef-4875-4ba4-94e0-c8275bfcf252] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:53:51.823951 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-08e5a69e-7230-4512-9f5d-894b928efc93 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12" status: 200 len: 1298 microversion: 2.1 time: 0.201997 Sep 12 23:53:51.824710 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 27/60] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:53:51 2022] GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12 => generated 1298 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:53:51.830640 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-12b88432-2ba8-4079-8ed2-dcff51be2d57 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:51.831483 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-12b88432-2ba8-4079-8ed2-dcff51be2d57 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:53:51.839380 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-12b88432-2ba8-4079-8ed2-dcff51be2d57 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:51.840175 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-12b88432-2ba8-4079-8ed2-dcff51be2d57 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:51.840720 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-12b88432-2ba8-4079-8ed2-dcff51be2d57 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:51.842578 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-12b88432-2ba8-4079-8ed2-dcff51be2d57 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:51.842578 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-12b88432-2ba8-4079-8ed2-dcff51be2d57 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:51.842578 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-12b88432-2ba8-4079-8ed2-dcff51be2d57 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:51.847762 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e7ab0682-5e8b-4505-b565-dac4a5105213 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:51.848578 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e7ab0682-5e8b-4505-b565-dac4a5105213 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:51.849219 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e7ab0682-5e8b-4505-b565-dac4a5105213 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:51.850186 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e7ab0682-5e8b-4505-b565-dac4a5105213 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:51.850688 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e7ab0682-5e8b-4505-b565-dac4a5105213 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:51.851151 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e7ab0682-5e8b-4505-b565-dac4a5105213 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:51.991747 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-12b88432-2ba8-4079-8ed2-dcff51be2d57 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:52.010266 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-12b88432-2ba8-4079-8ed2-dcff51be2d57 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:52.013984 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-12b88432-2ba8-4079-8ed2-dcff51be2d57 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:52.017145 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-12b88432-2ba8-4079-8ed2-dcff51be2d57 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1334 microversion: 2.20 time: 0.191005 Sep 12 23:53:52.019408 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 28/61] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:53:51 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1334 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:53:52.372925 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e7ab0682-5e8b-4505-b565-dac4a5105213 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:52.398457 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e7ab0682-5e8b-4505-b565-dac4a5105213 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252" status: 200 len: 1321 microversion: 2.1 time: 0.595732 Sep 12 23:53:52.399653 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 34/62] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:53:51 2022] GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252 => generated 1321 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:53:52.666627 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-6aa48e97-e526-4faa-b50a-2010ccb58795 req-ad6c147d-7340-4134-ab5f-b3e1fd29fa52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "695586a7-2b4d-477b-ab83-9e74f5f7078a", "tag": "c822ad88-7a3d-489a-9cdd-11e5745240c4"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:53:52.683073 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-6aa48e97-e526-4faa-b50a-2010ccb58795 req-ad6c147d-7340-4134-ab5f-b3e1fd29fa52 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:52.683900 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-6aa48e97-e526-4faa-b50a-2010ccb58795 req-ad6c147d-7340-4134-ab5f-b3e1fd29fa52 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:52.684684 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-6aa48e97-e526-4faa-b50a-2010ccb58795 req-ad6c147d-7340-4134-ab5f-b3e1fd29fa52 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:52.703929 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-6aa48e97-e526-4faa-b50a-2010ccb58795 req-ad6c147d-7340-4134-ab5f-b3e1fd29fa52 service nova] Creating event network-changed:c822ad88-7a3d-489a-9cdd-11e5745240c4 for instance 695586a7-2b4d-477b-ab83-9e74f5f7078a on hv-cinder-82002 Sep 12 23:53:52.710194 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-6aa48e97-e526-4faa-b50a-2010ccb58795 req-ad6c147d-7340-4134-ab5f-b3e1fd29fa52 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.215656 Sep 12 23:53:52.710957 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 29/63] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:53:52.828575 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f5ea01e0-7996-4f7d-823e-597308773900 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:52.829706 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f5ea01e0-7996-4f7d-823e-597308773900 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] [instance: cab7089c-6860-4148-9dd6-45939ee2c1a9] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:53:52.840260 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f5ea01e0-7996-4f7d-823e-597308773900 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:52.841037 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f5ea01e0-7996-4f7d-823e-597308773900 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:52.841741 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f5ea01e0-7996-4f7d-823e-597308773900 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:52.842921 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f5ea01e0-7996-4f7d-823e-597308773900 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:52.843688 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f5ea01e0-7996-4f7d-823e-597308773900 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:52.844367 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f5ea01e0-7996-4f7d-823e-597308773900 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:52.858671 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8ebec868-cf47-4282-b143-696180c45775 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:52.860184 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-8ebec868-cf47-4282-b143-696180c45775 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: 1bdd77eb-4b69-4630-9f49-a1d317bb1e12] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:53:52.868966 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8ebec868-cf47-4282-b143-696180c45775 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:52.870519 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8ebec868-cf47-4282-b143-696180c45775 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:52.871547 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8ebec868-cf47-4282-b143-696180c45775 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:52.872728 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8ebec868-cf47-4282-b143-696180c45775 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:52.873438 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8ebec868-cf47-4282-b143-696180c45775 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:52.874052 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8ebec868-cf47-4282-b143-696180c45775 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:53.120835 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8ebec868-cf47-4282-b143-696180c45775 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:53.131791 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-8ebec868-cf47-4282-b143-696180c45775 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12" status: 200 len: 1298 microversion: 2.1 time: 0.280578 Sep 12 23:53:53.132577 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 30/64] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:53:52 2022] GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12 => generated 1298 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:53:53.153484 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ddf2cfec-5443-4eda-8d0c-8600594b14d2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:53.154301 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ddf2cfec-5443-4eda-8d0c-8600594b14d2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:53:53.165269 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ddf2cfec-5443-4eda-8d0c-8600594b14d2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:53.165269 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ddf2cfec-5443-4eda-8d0c-8600594b14d2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:53.165759 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ddf2cfec-5443-4eda-8d0c-8600594b14d2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:53.166720 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ddf2cfec-5443-4eda-8d0c-8600594b14d2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:53.167422 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ddf2cfec-5443-4eda-8d0c-8600594b14d2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:53.168145 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ddf2cfec-5443-4eda-8d0c-8600594b14d2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:53.298702 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ddf2cfec-5443-4eda-8d0c-8600594b14d2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:53.309700 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ddf2cfec-5443-4eda-8d0c-8600594b14d2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:53.311563 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ddf2cfec-5443-4eda-8d0c-8600594b14d2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:53.312749 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ddf2cfec-5443-4eda-8d0c-8600594b14d2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1334 microversion: 2.20 time: 0.178743 Sep 12 23:53:53.313391 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 31/65] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:53:53 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1334 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:53:53.316747 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f5ea01e0-7996-4f7d-823e-597308773900 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46cf7ae501740869d677d0e9e007041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a7b6a5dc86486682777285fa3295ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:53.327296 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f5ea01e0-7996-4f7d-823e-597308773900 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] 10.222.0.26 "GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9" status: 200 len: 1315 microversion: 2.1 time: 0.505530 Sep 12 23:53:53.328171 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 35/66] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:53:52 2022] GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9 => generated 1315 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:53:53.425512 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9c7bfb08-c1da-4652-9d8f-c4084dfc22b0 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:53.426446 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9c7bfb08-c1da-4652-9d8f-c4084dfc22b0 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: f3ba81ef-4875-4ba4-94e0-c8275bfcf252] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:53:53.438866 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9c7bfb08-c1da-4652-9d8f-c4084dfc22b0 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:53.438866 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9c7bfb08-c1da-4652-9d8f-c4084dfc22b0 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:53.439630 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9c7bfb08-c1da-4652-9d8f-c4084dfc22b0 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:53.440850 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9c7bfb08-c1da-4652-9d8f-c4084dfc22b0 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:53.441640 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9c7bfb08-c1da-4652-9d8f-c4084dfc22b0 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:53.442611 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9c7bfb08-c1da-4652-9d8f-c4084dfc22b0 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:53.677426 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-9c7bfb08-c1da-4652-9d8f-c4084dfc22b0 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:53.687386 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9c7bfb08-c1da-4652-9d8f-c4084dfc22b0 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252" status: 200 len: 1321 microversion: 2.1 time: 0.267903 Sep 12 23:53:53.688458 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 32/67] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:53:53 2022] GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252 => generated 1321 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:53:54.174428 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-68322d5c-7179-4223-a110-9794add1f9f7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:54.175488 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-68322d5c-7179-4223-a110-9794add1f9f7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: 1bdd77eb-4b69-4630-9f49-a1d317bb1e12] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:53:54.178594 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell0:SELECT=2 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:54.198663 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-68322d5c-7179-4223-a110-9794add1f9f7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:54.199532 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-68322d5c-7179-4223-a110-9794add1f9f7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:54.200293 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-68322d5c-7179-4223-a110-9794add1f9f7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:54.201555 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-68322d5c-7179-4223-a110-9794add1f9f7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:54.202357 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-68322d5c-7179-4223-a110-9794add1f9f7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:54.203077 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-68322d5c-7179-4223-a110-9794add1f9f7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:54.349871 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a8fa2e6a-a5b2-4b73-91c4-d951f061bae3 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:54.350847 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a8fa2e6a-a5b2-4b73-91c4-d951f061bae3 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:53:54.380756 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a8fa2e6a-a5b2-4b73-91c4-d951f061bae3 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:54.384028 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a8fa2e6a-a5b2-4b73-91c4-d951f061bae3 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:54.384541 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a8fa2e6a-a5b2-4b73-91c4-d951f061bae3 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:54.391807 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a8fa2e6a-a5b2-4b73-91c4-d951f061bae3 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:54.392999 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a8fa2e6a-a5b2-4b73-91c4-d951f061bae3 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:54.396540 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a8fa2e6a-a5b2-4b73-91c4-d951f061bae3 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:54.512301 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-68322d5c-7179-4223-a110-9794add1f9f7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:54.576049 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-68322d5c-7179-4223-a110-9794add1f9f7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12" status: 200 len: 1298 microversion: 2.1 time: 0.406249 Sep 12 23:53:54.577261 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 36/68] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:53:54 2022] GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12 => generated 1298 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:53:54.652999 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-6ba483c6-6696-4eb2-981c-45668e71fab5 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:54.660949 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-6ba483c6-6696-4eb2-981c-45668e71fab5 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] [instance: cab7089c-6860-4148-9dd6-45939ee2c1a9] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:53:54.697997 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6ba483c6-6696-4eb2-981c-45668e71fab5 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:54.699511 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6ba483c6-6696-4eb2-981c-45668e71fab5 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:54.701409 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6ba483c6-6696-4eb2-981c-45668e71fab5 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:54.706877 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6ba483c6-6696-4eb2-981c-45668e71fab5 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:54.709633 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6ba483c6-6696-4eb2-981c-45668e71fab5 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:54.713048 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6ba483c6-6696-4eb2-981c-45668e71fab5 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:54.732691 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell0:SELECT=8 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:54.766310 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a8fa2e6a-a5b2-4b73-91c4-d951f061bae3 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:54.810319 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a8fa2e6a-a5b2-4b73-91c4-d951f061bae3 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:54.819450 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a8fa2e6a-a5b2-4b73-91c4-d951f061bae3 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:54.821771 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a8fa2e6a-a5b2-4b73-91c4-d951f061bae3 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1334 microversion: 2.20 time: 0.477830 Sep 12 23:53:54.828788 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 33/69] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:53:54 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1334 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:53:54.845043 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-656cf1cb-da1c-47f2-bf59-1817eca8d319 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:54.869246 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-656cf1cb-da1c-47f2-bf59-1817eca8d319 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: f3ba81ef-4875-4ba4-94e0-c8275bfcf252] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:53:54.884894 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-656cf1cb-da1c-47f2-bf59-1817eca8d319 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:54.885667 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-656cf1cb-da1c-47f2-bf59-1817eca8d319 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:54.886545 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-656cf1cb-da1c-47f2-bf59-1817eca8d319 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:54.887651 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-656cf1cb-da1c-47f2-bf59-1817eca8d319 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:54.889083 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-656cf1cb-da1c-47f2-bf59-1817eca8d319 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:54.890025 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-656cf1cb-da1c-47f2-bf59-1817eca8d319 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:55.163269 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-6ba483c6-6696-4eb2-981c-45668e71fab5 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46cf7ae501740869d677d0e9e007041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a7b6a5dc86486682777285fa3295ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:55.179281 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-6ba483c6-6696-4eb2-981c-45668e71fab5 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] 10.222.0.26 "GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9" status: 200 len: 1315 microversion: 2.1 time: 0.554128 Sep 12 23:53:55.180568 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 37/70] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:53:54 2022] GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9 => generated 1315 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:53:55.186062 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-50b78352-be0f-4cb1-8db3-3f76ea231436 req-b089768c-9308-4156-b9fd-823da7019469 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cab7089c-6860-4148-9dd6-45939ee2c1a9", "tag": "1c215802-5c5c-403a-8d38-46981edefef8"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:53:55.201703 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-50b78352-be0f-4cb1-8db3-3f76ea231436 req-b089768c-9308-4156-b9fd-823da7019469 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:55.203029 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-50b78352-be0f-4cb1-8db3-3f76ea231436 req-b089768c-9308-4156-b9fd-823da7019469 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:55.203029 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-50b78352-be0f-4cb1-8db3-3f76ea231436 req-b089768c-9308-4156-b9fd-823da7019469 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:55.237546 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-50b78352-be0f-4cb1-8db3-3f76ea231436 req-b089768c-9308-4156-b9fd-823da7019469 service nova] Creating event network-changed:1c215802-5c5c-403a-8d38-46981edefef8 for instance cab7089c-6860-4148-9dd6-45939ee2c1a9 on hv-cinder-82002 Sep 12 23:53:55.238949 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-50b78352-be0f-4cb1-8db3-3f76ea231436 req-b089768c-9308-4156-b9fd-823da7019469 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=126975) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 12 23:53:55.239973 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-50b78352-be0f-4cb1-8db3-3f76ea231436 req-b089768c-9308-4156-b9fd-823da7019469 service nova] Acquired lock "compute-rpcapi-router" {{(pid=126975) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 12 23:53:55.241900 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a57d1cf1-978d-42ca-97df-27706e58432b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:55.242065 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a57d1cf1-978d-42ca-97df-27706e58432b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:55.242720 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a57d1cf1-978d-42ca-97df-27706e58432b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:55.243825 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a57d1cf1-978d-42ca-97df-27706e58432b None None] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:55.244735 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a57d1cf1-978d-42ca-97df-27706e58432b None None] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:55.245441 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a57d1cf1-978d-42ca-97df-27706e58432b None None] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:55.259095 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.compute.rpcapi [None req-a57d1cf1-978d-42ca-97df-27706e58432b None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 12 23:53:55.260062 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a57d1cf1-978d-42ca-97df-27706e58432b None None] Releasing lock "compute-rpcapi-router" {{(pid=126975) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 12 23:53:55.279259 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a57d1cf1-978d-42ca-97df-27706e58432b None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096767 Sep 12 23:53:55.280519 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 38/71] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:53:55.284543 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-656cf1cb-da1c-47f2-bf59-1817eca8d319 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:55.294747 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-656cf1cb-da1c-47f2-bf59-1817eca8d319 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252" status: 200 len: 1321 microversion: 2.1 time: 0.464149 Sep 12 23:53:55.295434 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 34/72] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:53:54 2022] GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252 => generated 1321 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:53:55.628176 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-57b3f677-36ae-4330-b53a-8da835450d9f tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:55.634491 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-57b3f677-36ae-4330-b53a-8da835450d9f tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: 1bdd77eb-4b69-4630-9f49-a1d317bb1e12] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:53:55.669186 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-57b3f677-36ae-4330-b53a-8da835450d9f tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:55.673176 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-57b3f677-36ae-4330-b53a-8da835450d9f tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:55.676253 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-57b3f677-36ae-4330-b53a-8da835450d9f tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:55.681438 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-57b3f677-36ae-4330-b53a-8da835450d9f tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:55.685383 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-57b3f677-36ae-4330-b53a-8da835450d9f tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:55.691688 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-57b3f677-36ae-4330-b53a-8da835450d9f tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:55.879186 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-675b7caa-5d2f-4612-b855-1e35904f6932 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:55.880148 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-675b7caa-5d2f-4612-b855-1e35904f6932 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:53:55.892585 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-675b7caa-5d2f-4612-b855-1e35904f6932 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:55.893087 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-675b7caa-5d2f-4612-b855-1e35904f6932 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:55.893526 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-675b7caa-5d2f-4612-b855-1e35904f6932 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:55.894330 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-675b7caa-5d2f-4612-b855-1e35904f6932 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:55.894819 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-675b7caa-5d2f-4612-b855-1e35904f6932 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:55.898460 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-675b7caa-5d2f-4612-b855-1e35904f6932 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:56.188112 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-57b3f677-36ae-4330-b53a-8da835450d9f tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:56.200364 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-57b3f677-36ae-4330-b53a-8da835450d9f tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12" status: 200 len: 1298 microversion: 2.1 time: 0.580684 Sep 12 23:53:56.217739 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 39/73] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:53:55 2022] GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12 => generated 1298 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:53:56.226061 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2e89287f-72e1-45a6-930e-24f193368dfc tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:56.227038 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2e89287f-72e1-45a6-930e-24f193368dfc tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] [instance: cab7089c-6860-4148-9dd6-45939ee2c1a9] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:53:56.234283 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2e89287f-72e1-45a6-930e-24f193368dfc tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:56.235356 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2e89287f-72e1-45a6-930e-24f193368dfc tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:56.236011 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2e89287f-72e1-45a6-930e-24f193368dfc tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:56.236842 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2e89287f-72e1-45a6-930e-24f193368dfc tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:56.237366 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2e89287f-72e1-45a6-930e-24f193368dfc tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:56.238425 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2e89287f-72e1-45a6-930e-24f193368dfc tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:56.568258 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-675b7caa-5d2f-4612-b855-1e35904f6932 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:56.581083 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-675b7caa-5d2f-4612-b855-1e35904f6932 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:56.583915 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-675b7caa-5d2f-4612-b855-1e35904f6932 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:56.586702 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-675b7caa-5d2f-4612-b855-1e35904f6932 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1334 microversion: 2.20 time: 0.710543 Sep 12 23:53:56.589290 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 35/74] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:53:55 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1334 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 23:53:56.599383 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8d270b4a-02d7-40ef-896e-486eb5aa196a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:56.601027 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-8d270b4a-02d7-40ef-896e-486eb5aa196a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: f3ba81ef-4875-4ba4-94e0-c8275bfcf252] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:53:56.616041 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8d270b4a-02d7-40ef-896e-486eb5aa196a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:56.617049 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8d270b4a-02d7-40ef-896e-486eb5aa196a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:56.618835 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8d270b4a-02d7-40ef-896e-486eb5aa196a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:56.620562 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8d270b4a-02d7-40ef-896e-486eb5aa196a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:56.621959 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8d270b4a-02d7-40ef-896e-486eb5aa196a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:56.622720 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8d270b4a-02d7-40ef-896e-486eb5aa196a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:57.003504 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell0:SELECT=10 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:53:57.182536 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2e89287f-72e1-45a6-930e-24f193368dfc tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46cf7ae501740869d677d0e9e007041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a7b6a5dc86486682777285fa3295ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:57.194005 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2e89287f-72e1-45a6-930e-24f193368dfc tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] 10.222.0.26 "GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9" status: 200 len: 1315 microversion: 2.1 time: 0.974832 Sep 12 23:53:57.195257 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 40/75] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:53:56 2022] GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9 => generated 1315 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:53:57.229411 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e4ffd85e-1686-48b0-9550-756408bebcbe tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:57.230339 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e4ffd85e-1686-48b0-9550-756408bebcbe tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: 1bdd77eb-4b69-4630-9f49-a1d317bb1e12] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:53:57.237217 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e4ffd85e-1686-48b0-9550-756408bebcbe tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:57.237744 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e4ffd85e-1686-48b0-9550-756408bebcbe tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:57.238154 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e4ffd85e-1686-48b0-9550-756408bebcbe tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:57.238898 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e4ffd85e-1686-48b0-9550-756408bebcbe tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:57.239409 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e4ffd85e-1686-48b0-9550-756408bebcbe tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:57.239984 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e4ffd85e-1686-48b0-9550-756408bebcbe tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:57.288074 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8d270b4a-02d7-40ef-896e-486eb5aa196a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:57.304244 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-8d270b4a-02d7-40ef-896e-486eb5aa196a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252" status: 200 len: 1321 microversion: 2.1 time: 0.712302 Sep 12 23:53:57.306302 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 36/76] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:53:56 2022] GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252 => generated 1321 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:53:57.350790 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e4ffd85e-1686-48b0-9550-756408bebcbe tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:57.366117 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e4ffd85e-1686-48b0-9550-756408bebcbe tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12" status: 200 len: 1298 microversion: 2.1 time: 0.135536 Sep 12 23:53:57.367278 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 41/77] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:53:57 2022] GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12 => generated 1298 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:53:57.638316 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3e1c9500-f73b-4449-b11c-f7c56c41499d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:57.641874 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3e1c9500-f73b-4449-b11c-f7c56c41499d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:53:57.666294 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e1c9500-f73b-4449-b11c-f7c56c41499d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:57.670113 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e1c9500-f73b-4449-b11c-f7c56c41499d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:57.674912 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e1c9500-f73b-4449-b11c-f7c56c41499d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:57.676459 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e1c9500-f73b-4449-b11c-f7c56c41499d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:57.677131 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e1c9500-f73b-4449-b11c-f7c56c41499d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:57.677763 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e1c9500-f73b-4449-b11c-f7c56c41499d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:57.941462 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3e1c9500-f73b-4449-b11c-f7c56c41499d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:57.958055 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3e1c9500-f73b-4449-b11c-f7c56c41499d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:57.959651 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3e1c9500-f73b-4449-b11c-f7c56c41499d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:57.960830 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3e1c9500-f73b-4449-b11c-f7c56c41499d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1340 microversion: 2.20 time: 0.330962 Sep 12 23:53:57.965642 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 37/78] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:53:57 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1340 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:53:58.218404 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-cda2e733-be46-43f4-a326-9c3a9b294aa3 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:58.220001 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-cda2e733-be46-43f4-a326-9c3a9b294aa3 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] [instance: cab7089c-6860-4148-9dd6-45939ee2c1a9] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:53:58.236789 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cda2e733-be46-43f4-a326-9c3a9b294aa3 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:58.238378 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cda2e733-be46-43f4-a326-9c3a9b294aa3 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:58.238949 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cda2e733-be46-43f4-a326-9c3a9b294aa3 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:58.241421 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cda2e733-be46-43f4-a326-9c3a9b294aa3 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:58.241942 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cda2e733-be46-43f4-a326-9c3a9b294aa3 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:58.249754 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cda2e733-be46-43f4-a326-9c3a9b294aa3 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:58.337629 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-21c1aa86-5f90-4dd6-bfbc-b6da4a083b76 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:58.338265 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-21c1aa86-5f90-4dd6-bfbc-b6da4a083b76 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: f3ba81ef-4875-4ba4-94e0-c8275bfcf252] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:53:58.349965 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-21c1aa86-5f90-4dd6-bfbc-b6da4a083b76 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:58.350519 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-21c1aa86-5f90-4dd6-bfbc-b6da4a083b76 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:58.350962 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-21c1aa86-5f90-4dd6-bfbc-b6da4a083b76 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:58.351911 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-21c1aa86-5f90-4dd6-bfbc-b6da4a083b76 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:58.356070 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-21c1aa86-5f90-4dd6-bfbc-b6da4a083b76 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:58.356822 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-21c1aa86-5f90-4dd6-bfbc-b6da4a083b76 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:59.159991 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-cda2e733-be46-43f4-a326-9c3a9b294aa3 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46cf7ae501740869d677d0e9e007041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a7b6a5dc86486682777285fa3295ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:59.186872 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-cda2e733-be46-43f4-a326-9c3a9b294aa3 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] 10.222.0.26 "GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9" status: 200 len: 1315 microversion: 2.1 time: 0.972748 Sep 12 23:53:59.188112 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 42/79] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:53:58 2022] GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9 => generated 1315 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:53:59.196814 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-21c1aa86-5f90-4dd6-bfbc-b6da4a083b76 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:59.213748 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-10304856-6fee-47fc-b4bf-8579e135679c tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:59.216137 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-10304856-6fee-47fc-b4bf-8579e135679c tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: 1bdd77eb-4b69-4630-9f49-a1d317bb1e12] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:53:59.217746 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-21c1aa86-5f90-4dd6-bfbc-b6da4a083b76 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252" status: 200 len: 1321 microversion: 2.1 time: 0.883744 Sep 12 23:53:59.224960 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-10304856-6fee-47fc-b4bf-8579e135679c tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:59.225767 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-10304856-6fee-47fc-b4bf-8579e135679c tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:59.225767 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-10304856-6fee-47fc-b4bf-8579e135679c tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:59.226590 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-10304856-6fee-47fc-b4bf-8579e135679c tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:59.227120 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-10304856-6fee-47fc-b4bf-8579e135679c tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:59.239667 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-10304856-6fee-47fc-b4bf-8579e135679c tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:59.251608 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 38/80] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:53:58 2022] GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252 => generated 1321 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:53:59.256702 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b6fc1589-7002-4907-8a47-e649d5fca16f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:53:59.257313 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b6fc1589-7002-4907-8a47-e649d5fca16f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:53:59.268318 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b6fc1589-7002-4907-8a47-e649d5fca16f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:59.268805 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b6fc1589-7002-4907-8a47-e649d5fca16f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:59.269257 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b6fc1589-7002-4907-8a47-e649d5fca16f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:59.270245 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b6fc1589-7002-4907-8a47-e649d5fca16f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:53:59.270723 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b6fc1589-7002-4907-8a47-e649d5fca16f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:53:59.271309 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b6fc1589-7002-4907-8a47-e649d5fca16f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:53:59.382289 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-10304856-6fee-47fc-b4bf-8579e135679c tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:59.397467 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-10304856-6fee-47fc-b4bf-8579e135679c tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12" status: 200 len: 1298 microversion: 2.1 time: 0.189084 Sep 12 23:53:59.398073 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 43/81] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:53:59 2022] GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12 => generated 1298 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:53:59.683648 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b6fc1589-7002-4907-8a47-e649d5fca16f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:59.709889 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b6fc1589-7002-4907-8a47-e649d5fca16f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:59.713029 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b6fc1589-7002-4907-8a47-e649d5fca16f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:53:59.715164 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b6fc1589-7002-4907-8a47-e649d5fca16f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1408 microversion: 2.20 time: 0.462151 Sep 12 23:53:59.748478 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 39/82] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:53:59 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1408 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:54:00.215070 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9039e38a-da05-4153-bfdf-439e6fa31673 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:00.215742 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9039e38a-da05-4153-bfdf-439e6fa31673 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] [instance: cab7089c-6860-4148-9dd6-45939ee2c1a9] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:00.237231 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9039e38a-da05-4153-bfdf-439e6fa31673 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:00.239321 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9039e38a-da05-4153-bfdf-439e6fa31673 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:00.240601 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9039e38a-da05-4153-bfdf-439e6fa31673 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:00.242688 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9039e38a-da05-4153-bfdf-439e6fa31673 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:00.243855 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9039e38a-da05-4153-bfdf-439e6fa31673 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:00.244895 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9039e38a-da05-4153-bfdf-439e6fa31673 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:00.292547 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-34b1d0c9-8ba8-4f99-8579-aeb44de0c61f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:00.294164 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-34b1d0c9-8ba8-4f99-8579-aeb44de0c61f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: f3ba81ef-4875-4ba4-94e0-c8275bfcf252] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:00.361222 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-34b1d0c9-8ba8-4f99-8579-aeb44de0c61f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:00.362287 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-34b1d0c9-8ba8-4f99-8579-aeb44de0c61f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:00.363063 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-34b1d0c9-8ba8-4f99-8579-aeb44de0c61f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:00.364429 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-34b1d0c9-8ba8-4f99-8579-aeb44de0c61f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:00.365251 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-34b1d0c9-8ba8-4f99-8579-aeb44de0c61f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:00.366041 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-34b1d0c9-8ba8-4f99-8579-aeb44de0c61f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:00.647244 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9039e38a-da05-4153-bfdf-439e6fa31673 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46cf7ae501740869d677d0e9e007041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a7b6a5dc86486682777285fa3295ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:00.660064 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9039e38a-da05-4153-bfdf-439e6fa31673 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] 10.222.0.26 "GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9" status: 200 len: 1315 microversion: 2.1 time: 0.449350 Sep 12 23:54:00.661699 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 44/83] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:00 2022] GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9 => generated 1315 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:54:00.672988 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-834a9a36-694e-4865-94dc-fd4ab139d16a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:00.675092 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-834a9a36-694e-4865-94dc-fd4ab139d16a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: 1bdd77eb-4b69-4630-9f49-a1d317bb1e12] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:00.697532 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-834a9a36-694e-4865-94dc-fd4ab139d16a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:00.702954 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-834a9a36-694e-4865-94dc-fd4ab139d16a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:00.703831 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-834a9a36-694e-4865-94dc-fd4ab139d16a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:00.705913 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-834a9a36-694e-4865-94dc-fd4ab139d16a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:00.707099 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-834a9a36-694e-4865-94dc-fd4ab139d16a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:00.708642 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-834a9a36-694e-4865-94dc-fd4ab139d16a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:00.758938 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-34b1d0c9-8ba8-4f99-8579-aeb44de0c61f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:00.782607 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-34b1d0c9-8ba8-4f99-8579-aeb44de0c61f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252" status: 200 len: 1321 microversion: 2.1 time: 0.537514 Sep 12 23:54:00.783308 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 40/84] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:00 2022] GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252 => generated 1321 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:54:00.805435 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ad6bc28f-fbf8-4a68-adf6-6868a8e4e51d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:00.806119 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ad6bc28f-fbf8-4a68-adf6-6868a8e4e51d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:00.813416 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ad6bc28f-fbf8-4a68-adf6-6868a8e4e51d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:00.813971 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ad6bc28f-fbf8-4a68-adf6-6868a8e4e51d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:00.814411 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ad6bc28f-fbf8-4a68-adf6-6868a8e4e51d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:00.815139 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ad6bc28f-fbf8-4a68-adf6-6868a8e4e51d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:00.815625 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ad6bc28f-fbf8-4a68-adf6-6868a8e4e51d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:00.824819 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ad6bc28f-fbf8-4a68-adf6-6868a8e4e51d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:01.068387 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-834a9a36-694e-4865-94dc-fd4ab139d16a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:01.086764 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-834a9a36-694e-4865-94dc-fd4ab139d16a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12" status: 200 len: 1366 microversion: 2.1 time: 0.421749 Sep 12 23:54:01.088136 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 45/85] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:00 2022] GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12 => generated 1366 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:54:01.155723 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ad6bc28f-fbf8-4a68-adf6-6868a8e4e51d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:01.165670 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ad6bc28f-fbf8-4a68-adf6-6868a8e4e51d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:01.167173 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ad6bc28f-fbf8-4a68-adf6-6868a8e4e51d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:01.168399 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ad6bc28f-fbf8-4a68-adf6-6868a8e4e51d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1408 microversion: 2.20 time: 0.374421 Sep 12 23:54:01.168973 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 41/86] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:54:00 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1408 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:54:01.707128 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7e29bba3-c8ee-4cc8-83dd-84def02f992f tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:01.708112 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7e29bba3-c8ee-4cc8-83dd-84def02f992f tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] [instance: cab7089c-6860-4148-9dd6-45939ee2c1a9] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:01.721837 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7e29bba3-c8ee-4cc8-83dd-84def02f992f tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:01.722339 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7e29bba3-c8ee-4cc8-83dd-84def02f992f tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:01.722767 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7e29bba3-c8ee-4cc8-83dd-84def02f992f tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:01.723597 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7e29bba3-c8ee-4cc8-83dd-84def02f992f tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:01.727214 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7e29bba3-c8ee-4cc8-83dd-84def02f992f tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:01.729075 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7e29bba3-c8ee-4cc8-83dd-84def02f992f tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:01.740679 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:01.807276 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-25510a1a-82f0-4ea1-9f5d-cad8a562ad2f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:01.808460 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-25510a1a-82f0-4ea1-9f5d-cad8a562ad2f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: f3ba81ef-4875-4ba4-94e0-c8275bfcf252] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:01.817078 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell0:SELECT=4 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:01.822038 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-25510a1a-82f0-4ea1-9f5d-cad8a562ad2f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:01.823003 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-25510a1a-82f0-4ea1-9f5d-cad8a562ad2f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:01.823677 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-25510a1a-82f0-4ea1-9f5d-cad8a562ad2f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:01.826484 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-25510a1a-82f0-4ea1-9f5d-cad8a562ad2f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:01.827140 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-25510a1a-82f0-4ea1-9f5d-cad8a562ad2f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:01.828304 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-25510a1a-82f0-4ea1-9f5d-cad8a562ad2f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:01.875178 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:03.256652 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7e29bba3-c8ee-4cc8-83dd-84def02f992f tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46cf7ae501740869d677d0e9e007041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a7b6a5dc86486682777285fa3295ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:03.269439 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7e29bba3-c8ee-4cc8-83dd-84def02f992f tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] 10.222.0.26 "GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9" status: 200 len: 1315 microversion: 2.1 time: 1.566436 Sep 12 23:54:03.271078 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 46/87] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:01 2022] GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9 => generated 1315 bytes in 1569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:54:03.277344 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-6dfd54ac-a7b9-4bea-8809-d63d25cbf6d1 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:03.277974 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-6dfd54ac-a7b9-4bea-8809-d63d25cbf6d1 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: 1bdd77eb-4b69-4630-9f49-a1d317bb1e12] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:03.285973 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6dfd54ac-a7b9-4bea-8809-d63d25cbf6d1 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:03.286868 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6dfd54ac-a7b9-4bea-8809-d63d25cbf6d1 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:03.287341 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6dfd54ac-a7b9-4bea-8809-d63d25cbf6d1 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:03.288497 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6dfd54ac-a7b9-4bea-8809-d63d25cbf6d1 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:03.288969 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6dfd54ac-a7b9-4bea-8809-d63d25cbf6d1 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:03.289397 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6dfd54ac-a7b9-4bea-8809-d63d25cbf6d1 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:03.495893 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-25510a1a-82f0-4ea1-9f5d-cad8a562ad2f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:03.508189 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-25510a1a-82f0-4ea1-9f5d-cad8a562ad2f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252" status: 200 len: 1321 microversion: 2.1 time: 1.704673 Sep 12 23:54:03.510049 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 42/88] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:01 2022] GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252 => generated 1321 bytes in 1708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:54:03.520617 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-517b6a28-bb2b-4ee6-b164-35c6fc5cd094 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:03.521503 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-517b6a28-bb2b-4ee6-b164-35c6fc5cd094 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:03.534756 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-517b6a28-bb2b-4ee6-b164-35c6fc5cd094 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:03.535537 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-517b6a28-bb2b-4ee6-b164-35c6fc5cd094 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:03.536222 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-517b6a28-bb2b-4ee6-b164-35c6fc5cd094 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:03.537150 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-517b6a28-bb2b-4ee6-b164-35c6fc5cd094 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:03.537815 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-517b6a28-bb2b-4ee6-b164-35c6fc5cd094 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:03.538656 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-517b6a28-bb2b-4ee6-b164-35c6fc5cd094 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:03.725433 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-6dfd54ac-a7b9-4bea-8809-d63d25cbf6d1 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:03.744292 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-6dfd54ac-a7b9-4bea-8809-d63d25cbf6d1 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12" status: 200 len: 1366 microversion: 2.1 time: 0.471849 Sep 12 23:54:03.752915 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 47/89] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:03 2022] GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12 => generated 1366 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:54:03.752915 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-13c90fda-cc67-4500-be5b-0ed9c5c37493 req-0b07354f-e8d2-42ee-bda6-615f903860c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "893ed869-802c-4a92-b7ab-d2aa8324fb65", "tag": "3a5cf7e7-3d44-4786-8d75-99e5d72ef0e0"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:54:03.781802 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-13c90fda-cc67-4500-be5b-0ed9c5c37493 req-0b07354f-e8d2-42ee-bda6-615f903860c2 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:03.783389 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-13c90fda-cc67-4500-be5b-0ed9c5c37493 req-0b07354f-e8d2-42ee-bda6-615f903860c2 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:03.784052 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-13c90fda-cc67-4500-be5b-0ed9c5c37493 req-0b07354f-e8d2-42ee-bda6-615f903860c2 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:03.819561 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-13c90fda-cc67-4500-be5b-0ed9c5c37493 req-0b07354f-e8d2-42ee-bda6-615f903860c2 service nova] Creating event network-changed:3a5cf7e7-3d44-4786-8d75-99e5d72ef0e0 for instance 893ed869-802c-4a92-b7ab-d2aa8324fb65 on hv-cinder-82002 Sep 12 23:54:03.849659 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-13c90fda-cc67-4500-be5b-0ed9c5c37493 req-0b07354f-e8d2-42ee-bda6-615f903860c2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101025 Sep 12 23:54:03.852024 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 48/90] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:54:03.857875 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-517b6a28-bb2b-4ee6-b164-35c6fc5cd094 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:03.874089 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-517b6a28-bb2b-4ee6-b164-35c6fc5cd094 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:03.874089 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-517b6a28-bb2b-4ee6-b164-35c6fc5cd094 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:03.874089 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-517b6a28-bb2b-4ee6-b164-35c6fc5cd094 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1408 microversion: 2.20 time: 0.359748 Sep 12 23:54:03.879814 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 43/91] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:54:03 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1408 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:54:04.314900 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2b2beea1-0a58-4bc3-9f34-04e236a2fd9a tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:04.316369 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2b2beea1-0a58-4bc3-9f34-04e236a2fd9a tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] [instance: cab7089c-6860-4148-9dd6-45939ee2c1a9] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:04.327411 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2b2beea1-0a58-4bc3-9f34-04e236a2fd9a tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:04.327914 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2b2beea1-0a58-4bc3-9f34-04e236a2fd9a tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:04.328521 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2b2beea1-0a58-4bc3-9f34-04e236a2fd9a tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:04.329467 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2b2beea1-0a58-4bc3-9f34-04e236a2fd9a tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:04.330107 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2b2beea1-0a58-4bc3-9f34-04e236a2fd9a tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:04.332338 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2b2beea1-0a58-4bc3-9f34-04e236a2fd9a tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:04.483159 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-449e06cc-3d75-4e05-8cbd-5faa2ca56ef6 req-3683523c-41ed-4600-b8b3-3999594fef2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bdd77eb-4b69-4630-9f49-a1d317bb1e12", "tag": "41507fcf-1ad4-4940-9dad-33c3404dea2d"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:54:04.496887 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-449e06cc-3d75-4e05-8cbd-5faa2ca56ef6 req-3683523c-41ed-4600-b8b3-3999594fef2b service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:04.498911 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-449e06cc-3d75-4e05-8cbd-5faa2ca56ef6 req-3683523c-41ed-4600-b8b3-3999594fef2b service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:04.499916 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-449e06cc-3d75-4e05-8cbd-5faa2ca56ef6 req-3683523c-41ed-4600-b8b3-3999594fef2b service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:04.527588 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-449e06cc-3d75-4e05-8cbd-5faa2ca56ef6 req-3683523c-41ed-4600-b8b3-3999594fef2b service nova] Creating event network-changed:41507fcf-1ad4-4940-9dad-33c3404dea2d for instance 1bdd77eb-4b69-4630-9f49-a1d317bb1e12 on hv-cinder-82002 Sep 12 23:54:04.540195 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-449e06cc-3d75-4e05-8cbd-5faa2ca56ef6 req-3683523c-41ed-4600-b8b3-3999594fef2b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063305 Sep 12 23:54:04.545348 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 44/92] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 23:54:04.556796 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5d98e632-5cdd-4e48-806f-1441a7ff8206 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:04.556796 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5d98e632-5cdd-4e48-806f-1441a7ff8206 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: f3ba81ef-4875-4ba4-94e0-c8275bfcf252] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:04.563913 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5d98e632-5cdd-4e48-806f-1441a7ff8206 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:04.564751 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5d98e632-5cdd-4e48-806f-1441a7ff8206 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:04.565697 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5d98e632-5cdd-4e48-806f-1441a7ff8206 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:04.566961 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5d98e632-5cdd-4e48-806f-1441a7ff8206 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:04.567753 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5d98e632-5cdd-4e48-806f-1441a7ff8206 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:04.568458 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5d98e632-5cdd-4e48-806f-1441a7ff8206 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:04.607430 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2b2beea1-0a58-4bc3-9f34-04e236a2fd9a tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46cf7ae501740869d677d0e9e007041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a7b6a5dc86486682777285fa3295ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:04.621601 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2b2beea1-0a58-4bc3-9f34-04e236a2fd9a tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] 10.222.0.26 "GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9" status: 200 len: 1315 microversion: 2.1 time: 0.319899 Sep 12 23:54:04.622613 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 49/93] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:04 2022] GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9 => generated 1315 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:54:04.765033 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-5d98e632-5cdd-4e48-806f-1441a7ff8206 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:04.774313 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5d98e632-5cdd-4e48-806f-1441a7ff8206 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252" status: 200 len: 1321 microversion: 2.1 time: 0.226815 Sep 12 23:54:04.774994 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 45/94] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:04 2022] GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252 => generated 1321 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:54:04.785272 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e5300b03-197b-45d6-9d18-cfac1fbc5a21 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:04.786247 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e5300b03-197b-45d6-9d18-cfac1fbc5a21 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: 1bdd77eb-4b69-4630-9f49-a1d317bb1e12] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:04.793568 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e5300b03-197b-45d6-9d18-cfac1fbc5a21 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:04.794503 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e5300b03-197b-45d6-9d18-cfac1fbc5a21 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:04.794966 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e5300b03-197b-45d6-9d18-cfac1fbc5a21 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:04.795953 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e5300b03-197b-45d6-9d18-cfac1fbc5a21 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:04.796629 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e5300b03-197b-45d6-9d18-cfac1fbc5a21 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:04.797236 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e5300b03-197b-45d6-9d18-cfac1fbc5a21 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:04.901998 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-daeb181e-4314-4b38-84a9-47ecb228d7ed tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:04.902822 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-daeb181e-4314-4b38-84a9-47ecb228d7ed tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:04.914682 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-daeb181e-4314-4b38-84a9-47ecb228d7ed tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:04.915833 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-daeb181e-4314-4b38-84a9-47ecb228d7ed tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:04.916873 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-daeb181e-4314-4b38-84a9-47ecb228d7ed tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:04.918453 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-daeb181e-4314-4b38-84a9-47ecb228d7ed tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:04.919633 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-daeb181e-4314-4b38-84a9-47ecb228d7ed tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:04.920721 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-daeb181e-4314-4b38-84a9-47ecb228d7ed tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:05.082910 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e5300b03-197b-45d6-9d18-cfac1fbc5a21 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:05.094900 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e5300b03-197b-45d6-9d18-cfac1fbc5a21 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12" status: 200 len: 1366 microversion: 2.1 time: 0.313281 Sep 12 23:54:05.095770 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 50/95] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:04 2022] GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12 => generated 1366 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:54:05.145418 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-daeb181e-4314-4b38-84a9-47ecb228d7ed tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:05.161820 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-daeb181e-4314-4b38-84a9-47ecb228d7ed tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:05.164930 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-daeb181e-4314-4b38-84a9-47ecb228d7ed tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:05.166958 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-daeb181e-4314-4b38-84a9-47ecb228d7ed tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1408 microversion: 2.20 time: 0.272052 Sep 12 23:54:05.167993 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 46/96] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:54:04 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1408 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 23:54:05.649341 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4b862365-532f-4dc7-b8f6-1b6d06150f1a tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:05.650571 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4b862365-532f-4dc7-b8f6-1b6d06150f1a tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] [instance: cab7089c-6860-4148-9dd6-45939ee2c1a9] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:05.653765 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell0:SELECT=2 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:05.662550 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4b862365-532f-4dc7-b8f6-1b6d06150f1a tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:05.663326 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4b862365-532f-4dc7-b8f6-1b6d06150f1a tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:05.663716 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4b862365-532f-4dc7-b8f6-1b6d06150f1a tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:05.664458 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4b862365-532f-4dc7-b8f6-1b6d06150f1a tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:05.664972 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4b862365-532f-4dc7-b8f6-1b6d06150f1a tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:05.665469 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4b862365-532f-4dc7-b8f6-1b6d06150f1a tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:05.813531 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-652c0d0b-34eb-4585-9f23-9b4000d82e9f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:05.815046 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-652c0d0b-34eb-4585-9f23-9b4000d82e9f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: f3ba81ef-4875-4ba4-94e0-c8275bfcf252] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:05.824381 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-652c0d0b-34eb-4585-9f23-9b4000d82e9f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:05.825109 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-652c0d0b-34eb-4585-9f23-9b4000d82e9f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:05.825836 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-652c0d0b-34eb-4585-9f23-9b4000d82e9f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:05.827172 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-652c0d0b-34eb-4585-9f23-9b4000d82e9f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:05.827966 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-652c0d0b-34eb-4585-9f23-9b4000d82e9f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:05.828830 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-652c0d0b-34eb-4585-9f23-9b4000d82e9f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:05.865501 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4b862365-532f-4dc7-b8f6-1b6d06150f1a tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46cf7ae501740869d677d0e9e007041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a7b6a5dc86486682777285fa3295ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:05.880603 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4b862365-532f-4dc7-b8f6-1b6d06150f1a tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] 10.222.0.26 "GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9" status: 200 len: 1315 microversion: 2.1 time: 0.237570 Sep 12 23:54:05.882388 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 51/97] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:05 2022] GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:54:06.001062 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-652c0d0b-34eb-4585-9f23-9b4000d82e9f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:06.011101 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-652c0d0b-34eb-4585-9f23-9b4000d82e9f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252" status: 200 len: 1321 microversion: 2.1 time: 0.202054 Sep 12 23:54:06.011745 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 47/98] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:05 2022] GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252 => generated 1321 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:54:06.137221 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e269442d-2d9b-405c-af31-fe9ff51a0e8c tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:06.138523 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e269442d-2d9b-405c-af31-fe9ff51a0e8c tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: 1bdd77eb-4b69-4630-9f49-a1d317bb1e12] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:06.168840 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e269442d-2d9b-405c-af31-fe9ff51a0e8c tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:06.169720 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e269442d-2d9b-405c-af31-fe9ff51a0e8c tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:06.170415 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e269442d-2d9b-405c-af31-fe9ff51a0e8c tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:06.171725 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e269442d-2d9b-405c-af31-fe9ff51a0e8c tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:06.172739 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e269442d-2d9b-405c-af31-fe9ff51a0e8c tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:06.173686 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e269442d-2d9b-405c-af31-fe9ff51a0e8c tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:06.196938 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ac582d98-011e-45b7-9750-81f96becef74 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:06.198057 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ac582d98-011e-45b7-9750-81f96becef74 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:06.213387 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ac582d98-011e-45b7-9750-81f96becef74 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:06.214273 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ac582d98-011e-45b7-9750-81f96becef74 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:06.215912 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ac582d98-011e-45b7-9750-81f96becef74 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:06.218494 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ac582d98-011e-45b7-9750-81f96becef74 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:06.219846 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ac582d98-011e-45b7-9750-81f96becef74 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:06.222662 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ac582d98-011e-45b7-9750-81f96becef74 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:07.063437 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ac582d98-011e-45b7-9750-81f96becef74 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:07.065816 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e269442d-2d9b-405c-af31-fe9ff51a0e8c tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:07.077276 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e269442d-2d9b-405c-af31-fe9ff51a0e8c tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12" status: 200 len: 1366 microversion: 2.1 time: 0.947412 Sep 12 23:54:07.078017 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 52/99] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:06 2022] GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12 => generated 1366 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:54:07.096199 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ac582d98-011e-45b7-9750-81f96becef74 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:07.100844 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ac582d98-011e-45b7-9750-81f96becef74 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:07.102531 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ac582d98-011e-45b7-9750-81f96becef74 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1408 microversion: 2.20 time: 0.911178 Sep 12 23:54:07.115273 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 48/100] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:54:06 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1408 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:54:07.115273 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-dc526b3b-6784-4388-816e-39bdf5c14345 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:07.115273 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-dc526b3b-6784-4388-816e-39bdf5c14345 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] [instance: cab7089c-6860-4148-9dd6-45939ee2c1a9] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:07.117400 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dc526b3b-6784-4388-816e-39bdf5c14345 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:07.117974 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dc526b3b-6784-4388-816e-39bdf5c14345 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:07.118482 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dc526b3b-6784-4388-816e-39bdf5c14345 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:07.119307 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dc526b3b-6784-4388-816e-39bdf5c14345 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:07.120007 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dc526b3b-6784-4388-816e-39bdf5c14345 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:07.120351 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dc526b3b-6784-4388-816e-39bdf5c14345 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:07.281702 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-1884f5c4-f5c4-4180-8233-4498171adb99 req-a1cb0220-d879-48cc-9720-4369352798a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3ba81ef-4875-4ba4-94e0-c8275bfcf252", "name": "network-vif-plugged", "status": "completed", "tag": "b826088f-8d82-4b72-a304-bc22a8977946"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:54:07.299339 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-1884f5c4-f5c4-4180-8233-4498171adb99 req-a1cb0220-d879-48cc-9720-4369352798a9 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:07.299742 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-1884f5c4-f5c4-4180-8233-4498171adb99 req-a1cb0220-d879-48cc-9720-4369352798a9 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:07.300322 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-1884f5c4-f5c4-4180-8233-4498171adb99 req-a1cb0220-d879-48cc-9720-4369352798a9 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:07.344867 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-1884f5c4-f5c4-4180-8233-4498171adb99 req-a1cb0220-d879-48cc-9720-4369352798a9 service nova] Creating event network-vif-plugged:b826088f-8d82-4b72-a304-bc22a8977946 for instance f3ba81ef-4875-4ba4-94e0-c8275bfcf252 on hv-cinder-82002 Sep 12 23:54:07.351504 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-1884f5c4-f5c4-4180-8233-4498171adb99 req-a1cb0220-d879-48cc-9720-4369352798a9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.272096 Sep 12 23:54:07.352585 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 53/101] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:54:07.358761 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-72f8df09-9dca-40bb-827e-d1dcc88a9419 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:07.359509 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-72f8df09-9dca-40bb-827e-d1dcc88a9419 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: f3ba81ef-4875-4ba4-94e0-c8275bfcf252] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:07.366805 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-72f8df09-9dca-40bb-827e-d1dcc88a9419 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:07.367620 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-72f8df09-9dca-40bb-827e-d1dcc88a9419 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:07.368389 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-72f8df09-9dca-40bb-827e-d1dcc88a9419 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:07.369275 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-72f8df09-9dca-40bb-827e-d1dcc88a9419 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:07.370089 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-72f8df09-9dca-40bb-827e-d1dcc88a9419 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:07.370513 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-72f8df09-9dca-40bb-827e-d1dcc88a9419 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:07.591288 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-dc526b3b-6784-4388-816e-39bdf5c14345 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46cf7ae501740869d677d0e9e007041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a7b6a5dc86486682777285fa3295ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:07.603153 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-dc526b3b-6784-4388-816e-39bdf5c14345 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] 10.222.0.26 "GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9" status: 200 len: 1315 microversion: 2.1 time: 0.497420 Sep 12 23:54:07.604418 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 49/102] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:07 2022] GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9 => generated 1315 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:54:07.646418 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-72f8df09-9dca-40bb-827e-d1dcc88a9419 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:07.663115 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-72f8df09-9dca-40bb-827e-d1dcc88a9419 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252" status: 200 len: 1321 microversion: 2.1 time: 0.308733 Sep 12 23:54:07.675142 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 54/103] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:07 2022] GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252 => generated 1321 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:54:08.117496 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a25cc234-953b-40c8-b125-dfbb9853b5ee tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:08.118992 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a25cc234-953b-40c8-b125-dfbb9853b5ee tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: 1bdd77eb-4b69-4630-9f49-a1d317bb1e12] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:08.140827 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a25cc234-953b-40c8-b125-dfbb9853b5ee tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:08.147032 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a25cc234-953b-40c8-b125-dfbb9853b5ee tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:08.148899 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a25cc234-953b-40c8-b125-dfbb9853b5ee tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:08.150380 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a25cc234-953b-40c8-b125-dfbb9853b5ee tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:08.153890 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a25cc234-953b-40c8-b125-dfbb9853b5ee tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:08.157859 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a25cc234-953b-40c8-b125-dfbb9853b5ee tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:08.172416 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d86a5d8f-4e37-4b1b-8ac1-60e402428a47 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:08.173136 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d86a5d8f-4e37-4b1b-8ac1-60e402428a47 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:08.189852 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d86a5d8f-4e37-4b1b-8ac1-60e402428a47 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:08.194229 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d86a5d8f-4e37-4b1b-8ac1-60e402428a47 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:08.198374 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d86a5d8f-4e37-4b1b-8ac1-60e402428a47 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:08.199419 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d86a5d8f-4e37-4b1b-8ac1-60e402428a47 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:08.200090 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d86a5d8f-4e37-4b1b-8ac1-60e402428a47 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:08.206811 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d86a5d8f-4e37-4b1b-8ac1-60e402428a47 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:09.455455 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a25cc234-953b-40c8-b125-dfbb9853b5ee tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:09.494365 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a25cc234-953b-40c8-b125-dfbb9853b5ee tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12" status: 200 len: 1366 microversion: 2.1 time: 1.387396 Sep 12 23:54:09.497495 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 50/104] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:08 2022] GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12 => generated 1366 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:54:09.528270 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d86a5d8f-4e37-4b1b-8ac1-60e402428a47 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:09.532355 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0c35640c-8afc-480a-a4b7-3b9a499a8572 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:09.537146 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0c35640c-8afc-480a-a4b7-3b9a499a8572 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] [instance: cab7089c-6860-4148-9dd6-45939ee2c1a9] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:09.543952 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d86a5d8f-4e37-4b1b-8ac1-60e402428a47 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:09.546182 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d86a5d8f-4e37-4b1b-8ac1-60e402428a47 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:09.553873 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d86a5d8f-4e37-4b1b-8ac1-60e402428a47 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1408 microversion: 2.20 time: 1.387374 Sep 12 23:54:09.554765 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 55/105] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:54:08 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1408 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:54:09.563362 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-92217366-e1de-4f23-a146-1c30d6d512bb tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:09.566327 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c35640c-8afc-480a-a4b7-3b9a499a8572 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:09.567604 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-92217366-e1de-4f23-a146-1c30d6d512bb tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: f3ba81ef-4875-4ba4-94e0-c8275bfcf252] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:09.574197 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c35640c-8afc-480a-a4b7-3b9a499a8572 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:09.575279 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c35640c-8afc-480a-a4b7-3b9a499a8572 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:09.575913 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c35640c-8afc-480a-a4b7-3b9a499a8572 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:09.579384 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c35640c-8afc-480a-a4b7-3b9a499a8572 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:09.579961 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c35640c-8afc-480a-a4b7-3b9a499a8572 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:09.588865 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-92217366-e1de-4f23-a146-1c30d6d512bb tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:09.591689 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-92217366-e1de-4f23-a146-1c30d6d512bb tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:09.595649 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-92217366-e1de-4f23-a146-1c30d6d512bb tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:09.598163 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-92217366-e1de-4f23-a146-1c30d6d512bb tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:09.601616 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-92217366-e1de-4f23-a146-1c30d6d512bb tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:09.602953 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-92217366-e1de-4f23-a146-1c30d6d512bb tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:10.235945 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0c35640c-8afc-480a-a4b7-3b9a499a8572 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46cf7ae501740869d677d0e9e007041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a7b6a5dc86486682777285fa3295ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:10.251434 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0c35640c-8afc-480a-a4b7-3b9a499a8572 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] 10.222.0.26 "GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9" status: 200 len: 1315 microversion: 2.1 time: 0.747355 Sep 12 23:54:10.252661 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 51/106] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:09 2022] GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9 => generated 1315 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:54:10.273354 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-92217366-e1de-4f23-a146-1c30d6d512bb tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:10.287461 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-92217366-e1de-4f23-a146-1c30d6d512bb tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252" status: 200 len: 1321 microversion: 2.1 time: 0.730731 Sep 12 23:54:10.289584 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 56/107] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:09 2022] GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252 => generated 1321 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:54:10.533482 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-be589554-9e83-4a5d-bfab-1be45e95809c tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:10.535127 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-be589554-9e83-4a5d-bfab-1be45e95809c tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: 1bdd77eb-4b69-4630-9f49-a1d317bb1e12] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:10.546021 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-be589554-9e83-4a5d-bfab-1be45e95809c tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:10.546847 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-be589554-9e83-4a5d-bfab-1be45e95809c tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:10.547879 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-be589554-9e83-4a5d-bfab-1be45e95809c tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:10.549290 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-be589554-9e83-4a5d-bfab-1be45e95809c tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:10.550367 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-be589554-9e83-4a5d-bfab-1be45e95809c tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:10.550990 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-be589554-9e83-4a5d-bfab-1be45e95809c tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:10.600226 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-edb61cdf-0810-469f-a9f4-12e2bb04098a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:10.602501 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-edb61cdf-0810-469f-a9f4-12e2bb04098a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:10.615077 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-edb61cdf-0810-469f-a9f4-12e2bb04098a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:10.616270 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-edb61cdf-0810-469f-a9f4-12e2bb04098a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:10.617237 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-edb61cdf-0810-469f-a9f4-12e2bb04098a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:10.618924 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-edb61cdf-0810-469f-a9f4-12e2bb04098a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:10.619987 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-edb61cdf-0810-469f-a9f4-12e2bb04098a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:10.620933 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-edb61cdf-0810-469f-a9f4-12e2bb04098a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:10.914239 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-be589554-9e83-4a5d-bfab-1be45e95809c tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:10.928859 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-be589554-9e83-4a5d-bfab-1be45e95809c tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12" status: 200 len: 1366 microversion: 2.1 time: 0.403105 Sep 12 23:54:10.943182 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 52/108] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:10 2022] GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12 => generated 1366 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:54:11.051959 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-edb61cdf-0810-469f-a9f4-12e2bb04098a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:11.061015 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-edb61cdf-0810-469f-a9f4-12e2bb04098a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:11.066737 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-edb61cdf-0810-469f-a9f4-12e2bb04098a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:11.068505 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-edb61cdf-0810-469f-a9f4-12e2bb04098a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1408 microversion: 2.20 time: 0.475758 Sep 12 23:54:11.087417 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 57/109] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:54:10 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1408 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:54:11.290742 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2b3c3ed6-66c6-4b56-bad6-81ee1587e399 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:11.291353 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2b3c3ed6-66c6-4b56-bad6-81ee1587e399 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] [instance: cab7089c-6860-4148-9dd6-45939ee2c1a9] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:11.299253 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2b3c3ed6-66c6-4b56-bad6-81ee1587e399 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:11.300115 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2b3c3ed6-66c6-4b56-bad6-81ee1587e399 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:11.300761 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2b3c3ed6-66c6-4b56-bad6-81ee1587e399 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:11.301721 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2b3c3ed6-66c6-4b56-bad6-81ee1587e399 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:11.302286 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2b3c3ed6-66c6-4b56-bad6-81ee1587e399 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:11.302952 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2b3c3ed6-66c6-4b56-bad6-81ee1587e399 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:11.312638 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-558309e6-14dc-4565-941d-bfe2b0da960d tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:11.313598 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-558309e6-14dc-4565-941d-bfe2b0da960d tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: f3ba81ef-4875-4ba4-94e0-c8275bfcf252] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:11.322620 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-558309e6-14dc-4565-941d-bfe2b0da960d tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:11.328034 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-558309e6-14dc-4565-941d-bfe2b0da960d tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:11.328844 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-558309e6-14dc-4565-941d-bfe2b0da960d tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:11.329869 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-558309e6-14dc-4565-941d-bfe2b0da960d tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:11.330402 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-558309e6-14dc-4565-941d-bfe2b0da960d tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:11.330909 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-558309e6-14dc-4565-941d-bfe2b0da960d tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:11.625372 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-558309e6-14dc-4565-941d-bfe2b0da960d tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:11.630378 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2b3c3ed6-66c6-4b56-bad6-81ee1587e399 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46cf7ae501740869d677d0e9e007041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a7b6a5dc86486682777285fa3295ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:11.640064 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2b3c3ed6-66c6-4b56-bad6-81ee1587e399 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] 10.222.0.26 "GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9" status: 200 len: 1315 microversion: 2.1 time: 0.353528 Sep 12 23:54:11.641030 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 53/110] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:11 2022] GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9 => generated 1315 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:54:11.666921 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-558309e6-14dc-4565-941d-bfe2b0da960d tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252" status: 200 len: 1321 microversion: 2.1 time: 0.358199 Sep 12 23:54:11.679600 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 58/111] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:11 2022] GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252 => generated 1321 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:54:11.952582 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-67c9add6-a90a-4778-8e68-e0ab72795c40 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:11.953745 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-67c9add6-a90a-4778-8e68-e0ab72795c40 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: 1bdd77eb-4b69-4630-9f49-a1d317bb1e12] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:11.967721 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-67c9add6-a90a-4778-8e68-e0ab72795c40 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:11.968447 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-67c9add6-a90a-4778-8e68-e0ab72795c40 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:11.969068 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-67c9add6-a90a-4778-8e68-e0ab72795c40 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:11.970046 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-67c9add6-a90a-4778-8e68-e0ab72795c40 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:11.971400 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-67c9add6-a90a-4778-8e68-e0ab72795c40 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:11.972311 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-67c9add6-a90a-4778-8e68-e0ab72795c40 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:12.096968 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-24ed0ea6-399e-49d2-ae0b-cd80c97ca883 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:12.097785 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-24ed0ea6-399e-49d2-ae0b-cd80c97ca883 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:12.107853 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-24ed0ea6-399e-49d2-ae0b-cd80c97ca883 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:12.108453 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-24ed0ea6-399e-49d2-ae0b-cd80c97ca883 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:12.108960 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-24ed0ea6-399e-49d2-ae0b-cd80c97ca883 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:12.112034 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-24ed0ea6-399e-49d2-ae0b-cd80c97ca883 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:12.112825 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-24ed0ea6-399e-49d2-ae0b-cd80c97ca883 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:12.118050 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-24ed0ea6-399e-49d2-ae0b-cd80c97ca883 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:12.258195 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-67c9add6-a90a-4778-8e68-e0ab72795c40 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:12.273589 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-67c9add6-a90a-4778-8e68-e0ab72795c40 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12" status: 200 len: 1366 microversion: 2.1 time: 0.325552 Sep 12 23:54:12.277547 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 54/112] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:11 2022] GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12 => generated 1366 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:54:12.387928 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-24ed0ea6-399e-49d2-ae0b-cd80c97ca883 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:12.403203 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-24ed0ea6-399e-49d2-ae0b-cd80c97ca883 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:12.406071 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-24ed0ea6-399e-49d2-ae0b-cd80c97ca883 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:12.407629 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-24ed0ea6-399e-49d2-ae0b-cd80c97ca883 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1408 microversion: 2.20 time: 0.315121 Sep 12 23:54:12.408641 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 59/113] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:54:12 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1408 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:54:12.707899 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2cca84b1-98a5-4b01-a671-1658fc7e65ba tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:12.708648 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4b7d9724-33ba-44fb-b644-275e9f4a8b5d tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:12.714838 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-4b7d9724-33ba-44fb-b644-275e9f4a8b5d tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] [instance: cab7089c-6860-4148-9dd6-45939ee2c1a9] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:12.718653 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2cca84b1-98a5-4b01-a671-1658fc7e65ba tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: f3ba81ef-4875-4ba4-94e0-c8275bfcf252] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:12.778598 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2cca84b1-98a5-4b01-a671-1658fc7e65ba tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:12.778989 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4b7d9724-33ba-44fb-b644-275e9f4a8b5d tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:12.780725 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2cca84b1-98a5-4b01-a671-1658fc7e65ba tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:12.783200 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2cca84b1-98a5-4b01-a671-1658fc7e65ba tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:12.783556 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4b7d9724-33ba-44fb-b644-275e9f4a8b5d tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:12.784480 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4b7d9724-33ba-44fb-b644-275e9f4a8b5d tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:12.790931 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2cca84b1-98a5-4b01-a671-1658fc7e65ba tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:12.794687 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4b7d9724-33ba-44fb-b644-275e9f4a8b5d tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:12.796518 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2cca84b1-98a5-4b01-a671-1658fc7e65ba tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:12.799250 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4b7d9724-33ba-44fb-b644-275e9f4a8b5d tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:12.800287 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2cca84b1-98a5-4b01-a671-1658fc7e65ba tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:12.807372 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4b7d9724-33ba-44fb-b644-275e9f4a8b5d tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:13.336312 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2cca84b1-98a5-4b01-a671-1658fc7e65ba tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:13.363013 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2cca84b1-98a5-4b01-a671-1658fc7e65ba tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252" status: 200 len: 1321 microversion: 2.1 time: 0.672953 Sep 12 23:54:13.365281 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 60/114] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:12 2022] GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252 => generated 1321 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:54:13.375264 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-0d6c00b9-fe84-4a57-a39f-8a9ce5599318 req-3654da9e-0dc7-4d2e-89e1-30adf15c7ae0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "695586a7-2b4d-477b-ab83-9e74f5f7078a", "name": "network-vif-plugged", "status": "completed", "tag": "c822ad88-7a3d-489a-9cdd-11e5745240c4"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:54:13.395765 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-0d6c00b9-fe84-4a57-a39f-8a9ce5599318 req-3654da9e-0dc7-4d2e-89e1-30adf15c7ae0 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:13.396345 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4b7d9724-33ba-44fb-b644-275e9f4a8b5d tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46cf7ae501740869d677d0e9e007041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a7b6a5dc86486682777285fa3295ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:13.396994 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-0d6c00b9-fe84-4a57-a39f-8a9ce5599318 req-3654da9e-0dc7-4d2e-89e1-30adf15c7ae0 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:13.398689 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-0d6c00b9-fe84-4a57-a39f-8a9ce5599318 req-3654da9e-0dc7-4d2e-89e1-30adf15c7ae0 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:13.410964 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-4b7d9724-33ba-44fb-b644-275e9f4a8b5d tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] 10.222.0.26 "GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9" status: 200 len: 1315 microversion: 2.1 time: 0.729834 Sep 12 23:54:13.411887 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 55/115] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:12 2022] GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9 => generated 1315 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:54:13.422362 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-dc482e9a-afaf-4980-b654-69c30ca6e8e0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:13.423779 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-dc482e9a-afaf-4980-b654-69c30ca6e8e0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: 1bdd77eb-4b69-4630-9f49-a1d317bb1e12] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:13.427791 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-0d6c00b9-fe84-4a57-a39f-8a9ce5599318 req-3654da9e-0dc7-4d2e-89e1-30adf15c7ae0 service nova] Creating event network-vif-plugged:c822ad88-7a3d-489a-9cdd-11e5745240c4 for instance 695586a7-2b4d-477b-ab83-9e74f5f7078a on hv-cinder-82002 Sep 12 23:54:13.435776 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dc482e9a-afaf-4980-b654-69c30ca6e8e0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:13.437033 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dc482e9a-afaf-4980-b654-69c30ca6e8e0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:13.438023 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dc482e9a-afaf-4980-b654-69c30ca6e8e0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:13.438900 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dc482e9a-afaf-4980-b654-69c30ca6e8e0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:13.439745 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dc482e9a-afaf-4980-b654-69c30ca6e8e0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:13.440533 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dc482e9a-afaf-4980-b654-69c30ca6e8e0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:13.441843 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-0d6c00b9-fe84-4a57-a39f-8a9ce5599318 req-3654da9e-0dc7-4d2e-89e1-30adf15c7ae0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073745 Sep 12 23:54:13.443276 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 61/116] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:54:13.452913 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c047c015-dfb1-4c6d-b213-9ab40eba35eb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:13.454752 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c047c015-dfb1-4c6d-b213-9ab40eba35eb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:13.467611 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c047c015-dfb1-4c6d-b213-9ab40eba35eb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:13.468936 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c047c015-dfb1-4c6d-b213-9ab40eba35eb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:13.470280 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c047c015-dfb1-4c6d-b213-9ab40eba35eb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:13.473253 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c047c015-dfb1-4c6d-b213-9ab40eba35eb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:13.474452 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c047c015-dfb1-4c6d-b213-9ab40eba35eb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:13.476185 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c047c015-dfb1-4c6d-b213-9ab40eba35eb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:13.959920 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c047c015-dfb1-4c6d-b213-9ab40eba35eb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:13.971989 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c047c015-dfb1-4c6d-b213-9ab40eba35eb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:13.977010 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c047c015-dfb1-4c6d-b213-9ab40eba35eb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:13.981736 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c047c015-dfb1-4c6d-b213-9ab40eba35eb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1408 microversion: 2.20 time: 0.536467 Sep 12 23:54:13.985704 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 62/117] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:54:13 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1408 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:54:14.001236 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-dc482e9a-afaf-4980-b654-69c30ca6e8e0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:14.013879 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-dc482e9a-afaf-4980-b654-69c30ca6e8e0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12" status: 200 len: 1366 microversion: 2.1 time: 0.600118 Sep 12 23:54:14.014512 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 56/118] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:13 2022] GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12 => generated 1366 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:54:14.397309 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-89e8009a-bbb9-47f0-9d41-280263cbaab7 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:14.398478 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-89e8009a-bbb9-47f0-9d41-280263cbaab7 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: f3ba81ef-4875-4ba4-94e0-c8275bfcf252] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:14.411771 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-89e8009a-bbb9-47f0-9d41-280263cbaab7 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:14.413006 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-89e8009a-bbb9-47f0-9d41-280263cbaab7 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:14.413920 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-89e8009a-bbb9-47f0-9d41-280263cbaab7 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:14.415453 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-89e8009a-bbb9-47f0-9d41-280263cbaab7 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:14.416523 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-89e8009a-bbb9-47f0-9d41-280263cbaab7 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:14.417458 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-89e8009a-bbb9-47f0-9d41-280263cbaab7 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:14.442343 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-031aa71a-0817-4d64-8ed7-4c9f6243b2d6 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:14.443954 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-031aa71a-0817-4d64-8ed7-4c9f6243b2d6 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] [instance: cab7089c-6860-4148-9dd6-45939ee2c1a9] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:14.472194 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-031aa71a-0817-4d64-8ed7-4c9f6243b2d6 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:14.475050 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-031aa71a-0817-4d64-8ed7-4c9f6243b2d6 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:14.475769 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-031aa71a-0817-4d64-8ed7-4c9f6243b2d6 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:14.479099 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-031aa71a-0817-4d64-8ed7-4c9f6243b2d6 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:14.480164 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-031aa71a-0817-4d64-8ed7-4c9f6243b2d6 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:14.482666 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-031aa71a-0817-4d64-8ed7-4c9f6243b2d6 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:14.738477 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-89e8009a-bbb9-47f0-9d41-280263cbaab7 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:14.746998 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-89e8009a-bbb9-47f0-9d41-280263cbaab7 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252" status: 200 len: 1515 microversion: 2.1 time: 0.357563 Sep 12 23:54:14.748251 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 63/119] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:14 2022] GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252 => generated 1515 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:54:14.771700 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-031aa71a-0817-4d64-8ed7-4c9f6243b2d6 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46cf7ae501740869d677d0e9e007041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a7b6a5dc86486682777285fa3295ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:14.789317 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8c873863-04bf-4af9-a597-0381a9428e61 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:54:14.791193 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-031aa71a-0817-4d64-8ed7-4c9f6243b2d6 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] 10.222.0.26 "GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9" status: 200 len: 1315 microversion: 2.1 time: 0.355473 Sep 12 23:54:14.792523 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 57/120] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:14 2022] GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9 => generated 1315 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:54:14.796425 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8c873863-04bf-4af9-a597-0381a9428e61 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: f3ba81ef-4875-4ba4-94e0-c8275bfcf252] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:14.805511 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8c873863-04bf-4af9-a597-0381a9428e61 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:14.806032 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8c873863-04bf-4af9-a597-0381a9428e61 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:14.806615 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8c873863-04bf-4af9-a597-0381a9428e61 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:14.807357 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8c873863-04bf-4af9-a597-0381a9428e61 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:14.807973 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8c873863-04bf-4af9-a597-0381a9428e61 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:14.808565 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8c873863-04bf-4af9-a597-0381a9428e61 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:14.895350 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.objects.instance [None req-8c873863-04bf-4af9-a597-0381a9428e61 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lazy-loading 'flavor' on Instance uuid f3ba81ef-4875-4ba4-94e0-c8275bfcf252 {{(pid=126975) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 23:54:14.944093 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:15.043365 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-77403fea-3e82-40bd-b162-e11d27b9bd7b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:15.045757 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-77403fea-3e82-40bd-b162-e11d27b9bd7b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:15.069572 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-77403fea-3e82-40bd-b162-e11d27b9bd7b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:15.071241 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-77403fea-3e82-40bd-b162-e11d27b9bd7b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:15.074246 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-77403fea-3e82-40bd-b162-e11d27b9bd7b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:15.076243 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-77403fea-3e82-40bd-b162-e11d27b9bd7b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:15.078864 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-77403fea-3e82-40bd-b162-e11d27b9bd7b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:15.080128 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-77403fea-3e82-40bd-b162-e11d27b9bd7b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:15.143299 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8c873863-04bf-4af9-a597-0381a9428e61 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "POST /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252/action" status: 200 len: 32 microversion: 2.1 time: 0.364143 Sep 12 23:54:15.143974 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 64/121] 10.222.0.26 () {60 vars in 1278 bytes} [Mon Sep 12 23:54:14 2022] POST /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252/action => generated 32 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 12 23:54:15.155360 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a1ac818c-f90e-4fba-8771-351376100bd7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:15.158385 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a1ac818c-f90e-4fba-8771-351376100bd7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: 1bdd77eb-4b69-4630-9f49-a1d317bb1e12] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:15.174185 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a1ac818c-f90e-4fba-8771-351376100bd7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:15.175106 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a1ac818c-f90e-4fba-8771-351376100bd7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:15.176033 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a1ac818c-f90e-4fba-8771-351376100bd7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:15.177375 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a1ac818c-f90e-4fba-8771-351376100bd7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:15.178190 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a1ac818c-f90e-4fba-8771-351376100bd7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:15.178916 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a1ac818c-f90e-4fba-8771-351376100bd7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:15.545976 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-77403fea-3e82-40bd-b162-e11d27b9bd7b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:15.562107 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a1ac818c-f90e-4fba-8771-351376100bd7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:15.579517 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a1ac818c-f90e-4fba-8771-351376100bd7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12" status: 200 len: 1366 microversion: 2.1 time: 0.432561 Sep 12 23:54:15.583437 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-77403fea-3e82-40bd-b162-e11d27b9bd7b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:15.590741 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-77403fea-3e82-40bd-b162-e11d27b9bd7b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:15.593543 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-77403fea-3e82-40bd-b162-e11d27b9bd7b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1408 microversion: 2.20 time: 0.558633 Sep 12 23:54:15.612633 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 58/123] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:54:15 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1408 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 23:54:15.612892 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 65/123] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:15 2022] GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12 => generated 1366 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:54:15.625517 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9eef021a-6270-4699-b031-1e5a54988be3 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:15.636090 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9eef021a-6270-4699-b031-1e5a54988be3 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: f3ba81ef-4875-4ba4-94e0-c8275bfcf252] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:15.640332 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-ba241d1a-d866-47a8-ac3b-59bc2eb4d1d8 req-07a4f1e1-fa2b-4852-9722-8573fb2bb22b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cab7089c-6860-4148-9dd6-45939ee2c1a9", "name": "network-vif-plugged", "status": "completed", "tag": "1c215802-5c5c-403a-8d38-46981edefef8"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:54:15.653782 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9eef021a-6270-4699-b031-1e5a54988be3 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:15.654992 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9eef021a-6270-4699-b031-1e5a54988be3 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:15.662042 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9eef021a-6270-4699-b031-1e5a54988be3 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:15.663402 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9eef021a-6270-4699-b031-1e5a54988be3 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:15.664220 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9eef021a-6270-4699-b031-1e5a54988be3 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:15.664971 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9eef021a-6270-4699-b031-1e5a54988be3 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:15.682979 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-ba241d1a-d866-47a8-ac3b-59bc2eb4d1d8 req-07a4f1e1-fa2b-4852-9722-8573fb2bb22b service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:15.685823 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-ba241d1a-d866-47a8-ac3b-59bc2eb4d1d8 req-07a4f1e1-fa2b-4852-9722-8573fb2bb22b service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:15.686711 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-ba241d1a-d866-47a8-ac3b-59bc2eb4d1d8 req-07a4f1e1-fa2b-4852-9722-8573fb2bb22b service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:15.729158 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-ba241d1a-d866-47a8-ac3b-59bc2eb4d1d8 req-07a4f1e1-fa2b-4852-9722-8573fb2bb22b service nova] Creating event network-vif-plugged:1c215802-5c5c-403a-8d38-46981edefef8 for instance cab7089c-6860-4148-9dd6-45939ee2c1a9 on hv-cinder-82002 Sep 12 23:54:15.743598 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-ba241d1a-d866-47a8-ac3b-59bc2eb4d1d8 req-07a4f1e1-fa2b-4852-9722-8573fb2bb22b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122575 Sep 12 23:54:15.745839 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 59/124] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:54:15.821469 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-159ee341-28a3-45ba-b1a8-fd91f3fc6bc3 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:15.822860 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-159ee341-28a3-45ba-b1a8-fd91f3fc6bc3 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] [instance: cab7089c-6860-4148-9dd6-45939ee2c1a9] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:15.835822 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-159ee341-28a3-45ba-b1a8-fd91f3fc6bc3 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:15.836886 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-159ee341-28a3-45ba-b1a8-fd91f3fc6bc3 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:15.838465 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-159ee341-28a3-45ba-b1a8-fd91f3fc6bc3 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:15.840002 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-159ee341-28a3-45ba-b1a8-fd91f3fc6bc3 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:15.841504 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-159ee341-28a3-45ba-b1a8-fd91f3fc6bc3 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:15.842572 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-159ee341-28a3-45ba-b1a8-fd91f3fc6bc3 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:15.872383 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:16.213246 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9eef021a-6270-4699-b031-1e5a54988be3 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:16.221536 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9eef021a-6270-4699-b031-1e5a54988be3 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252" status: 200 len: 1521 microversion: 2.1 time: 0.607030 Sep 12 23:54:16.222132 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 66/125] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:15 2022] GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252 => generated 1521 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:54:16.374090 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-159ee341-28a3-45ba-b1a8-fd91f3fc6bc3 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46cf7ae501740869d677d0e9e007041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a7b6a5dc86486682777285fa3295ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:16.394754 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-159ee341-28a3-45ba-b1a8-fd91f3fc6bc3 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] 10.222.0.26 "GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9" status: 200 len: 1315 microversion: 2.1 time: 0.581081 Sep 12 23:54:16.396241 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 60/126] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:15 2022] GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9 => generated 1315 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:54:16.629482 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9a71b8a7-4b1d-4cbd-8766-26161306763b tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:16.630859 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9a71b8a7-4b1d-4cbd-8766-26161306763b tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: 1bdd77eb-4b69-4630-9f49-a1d317bb1e12] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:16.647084 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=76 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:16.647084 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9a71b8a7-4b1d-4cbd-8766-26161306763b tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:16.647084 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9a71b8a7-4b1d-4cbd-8766-26161306763b tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:16.647084 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9a71b8a7-4b1d-4cbd-8766-26161306763b tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:16.647687 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9a71b8a7-4b1d-4cbd-8766-26161306763b tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:16.647687 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9a71b8a7-4b1d-4cbd-8766-26161306763b tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:16.647687 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9a71b8a7-4b1d-4cbd-8766-26161306763b tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:16.659635 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-747c91ee-73ef-477e-bc66-ac8e64d5caa5 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:16.659635 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-747c91ee-73ef-477e-bc66-ac8e64d5caa5 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:16.665668 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-747c91ee-73ef-477e-bc66-ac8e64d5caa5 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:16.666284 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-747c91ee-73ef-477e-bc66-ac8e64d5caa5 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:16.666564 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-747c91ee-73ef-477e-bc66-ac8e64d5caa5 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:16.676363 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-747c91ee-73ef-477e-bc66-ac8e64d5caa5 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:16.677248 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-747c91ee-73ef-477e-bc66-ac8e64d5caa5 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:16.677694 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-747c91ee-73ef-477e-bc66-ac8e64d5caa5 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:17.561877 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9a71b8a7-4b1d-4cbd-8766-26161306763b tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:17.586256 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9a71b8a7-4b1d-4cbd-8766-26161306763b tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12" status: 200 len: 1366 microversion: 2.1 time: 0.962979 Sep 12 23:54:17.588169 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 67/127] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:16 2022] GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12 => generated 1366 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:54:17.597696 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-747c91ee-73ef-477e-bc66-ac8e64d5caa5 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:17.599877 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1a3b731a-74b1-440e-a756-ef96f354005f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:17.601413 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1a3b731a-74b1-440e-a756-ef96f354005f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: f3ba81ef-4875-4ba4-94e0-c8275bfcf252] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:17.610504 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-747c91ee-73ef-477e-bc66-ac8e64d5caa5 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:17.612721 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-747c91ee-73ef-477e-bc66-ac8e64d5caa5 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:17.614435 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-747c91ee-73ef-477e-bc66-ac8e64d5caa5 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1408 microversion: 2.20 time: 0.963488 Sep 12 23:54:17.615605 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 61/128] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:54:16 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1408 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:54:17.621176 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-09c672ee-3642-4f83-9c90-940e43ba4cba tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:17.621989 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-09c672ee-3642-4f83-9c90-940e43ba4cba tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] [instance: cab7089c-6860-4148-9dd6-45939ee2c1a9] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:17.625726 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1a3b731a-74b1-440e-a756-ef96f354005f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:17.629192 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-09c672ee-3642-4f83-9c90-940e43ba4cba tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:17.629872 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-09c672ee-3642-4f83-9c90-940e43ba4cba tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:17.630433 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-09c672ee-3642-4f83-9c90-940e43ba4cba tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:17.631421 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-09c672ee-3642-4f83-9c90-940e43ba4cba tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:17.631865 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-09c672ee-3642-4f83-9c90-940e43ba4cba tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:17.632275 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-09c672ee-3642-4f83-9c90-940e43ba4cba tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:17.645137 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1a3b731a-74b1-440e-a756-ef96f354005f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:17.645788 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1a3b731a-74b1-440e-a756-ef96f354005f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:17.646653 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1a3b731a-74b1-440e-a756-ef96f354005f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:17.647138 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1a3b731a-74b1-440e-a756-ef96f354005f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:17.647630 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1a3b731a-74b1-440e-a756-ef96f354005f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:18.299163 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-09c672ee-3642-4f83-9c90-940e43ba4cba tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46cf7ae501740869d677d0e9e007041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a7b6a5dc86486682777285fa3295ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:18.311548 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-09c672ee-3642-4f83-9c90-940e43ba4cba tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] 10.222.0.26 "GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9" status: 200 len: 1315 microversion: 2.1 time: 0.694643 Sep 12 23:54:18.314200 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 62/129] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:17 2022] GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9 => generated 1315 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:54:18.319488 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-c2165d8d-066c-4b62-b287-6aadafeb31fd req-8f475427-d3be-4a5e-a0ab-61fb1ba9cf10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bdd77eb-4b69-4630-9f49-a1d317bb1e12", "name": "network-vif-plugged", "status": "completed", "tag": "41507fcf-1ad4-4940-9dad-33c3404dea2d"}, {"server_uuid": "893ed869-802c-4a92-b7ab-d2aa8324fb65", "name": "network-vif-plugged", "status": "completed", "tag": "3a5cf7e7-3d44-4786-8d75-99e5d72ef0e0"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:54:18.320370 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-1a3b731a-74b1-440e-a756-ef96f354005f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:18.328719 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1a3b731a-74b1-440e-a756-ef96f354005f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252" status: 200 len: 1521 microversion: 2.1 time: 0.738895 Sep 12 23:54:18.329554 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 68/130] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:17 2022] GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252 => generated 1521 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:54:18.333513 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-c2165d8d-066c-4b62-b287-6aadafeb31fd req-8f475427-d3be-4a5e-a0ab-61fb1ba9cf10 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:18.334255 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-c2165d8d-066c-4b62-b287-6aadafeb31fd req-8f475427-d3be-4a5e-a0ab-61fb1ba9cf10 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:18.334686 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-c2165d8d-066c-4b62-b287-6aadafeb31fd req-8f475427-d3be-4a5e-a0ab-61fb1ba9cf10 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:18.349679 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-c2165d8d-066c-4b62-b287-6aadafeb31fd req-8f475427-d3be-4a5e-a0ab-61fb1ba9cf10 service nova] Creating event network-vif-plugged:41507fcf-1ad4-4940-9dad-33c3404dea2d for instance 1bdd77eb-4b69-4630-9f49-a1d317bb1e12 on hv-cinder-82002 Sep 12 23:54:18.350371 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-c2165d8d-066c-4b62-b287-6aadafeb31fd req-8f475427-d3be-4a5e-a0ab-61fb1ba9cf10 service nova] Creating event network-vif-plugged:3a5cf7e7-3d44-4786-8d75-99e5d72ef0e0 for instance 893ed869-802c-4a92-b7ab-d2aa8324fb65 on hv-cinder-82002 Sep 12 23:54:18.361993 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-c2165d8d-066c-4b62-b287-6aadafeb31fd req-8f475427-d3be-4a5e-a0ab-61fb1ba9cf10 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.046207 Sep 12 23:54:18.362775 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 63/131] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:54:18.635836 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-08db7fd6-2450-4df4-9928-2eada39f6908 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:18.637146 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-08db7fd6-2450-4df4-9928-2eada39f6908 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: 1bdd77eb-4b69-4630-9f49-a1d317bb1e12] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:18.650053 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-08db7fd6-2450-4df4-9928-2eada39f6908 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:18.650987 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-08db7fd6-2450-4df4-9928-2eada39f6908 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:18.653807 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-08db7fd6-2450-4df4-9928-2eada39f6908 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:18.658677 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-08db7fd6-2450-4df4-9928-2eada39f6908 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:18.659438 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-08db7fd6-2450-4df4-9928-2eada39f6908 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:18.669623 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-819f1dab-8f7f-4739-97e3-3048309dc5c7 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:18.670714 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-819f1dab-8f7f-4739-97e3-3048309dc5c7 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:18.675073 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-08db7fd6-2450-4df4-9928-2eada39f6908 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:18.687946 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-819f1dab-8f7f-4739-97e3-3048309dc5c7 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:18.688451 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-819f1dab-8f7f-4739-97e3-3048309dc5c7 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:18.688883 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-819f1dab-8f7f-4739-97e3-3048309dc5c7 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:18.689592 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-819f1dab-8f7f-4739-97e3-3048309dc5c7 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:18.690043 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-819f1dab-8f7f-4739-97e3-3048309dc5c7 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:18.690456 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-819f1dab-8f7f-4739-97e3-3048309dc5c7 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:19.375418 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-819f1dab-8f7f-4739-97e3-3048309dc5c7 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:19.384563 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-819f1dab-8f7f-4739-97e3-3048309dc5c7 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:19.386054 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-819f1dab-8f7f-4739-97e3-3048309dc5c7 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:19.387446 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-819f1dab-8f7f-4739-97e3-3048309dc5c7 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1408 microversion: 2.20 time: 0.723661 Sep 12 23:54:19.387816 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 64/132] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:54:18 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1408 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:54:19.401819 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-08db7fd6-2450-4df4-9928-2eada39f6908 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:19.409271 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-420c900c-f2ac-4221-a1c3-5672f4748e43 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:19.409922 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-420c900c-f2ac-4221-a1c3-5672f4748e43 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] [instance: cab7089c-6860-4148-9dd6-45939ee2c1a9] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:19.416199 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-08db7fd6-2450-4df4-9928-2eada39f6908 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12" status: 200 len: 1366 microversion: 2.1 time: 0.788590 Sep 12 23:54:19.416807 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 69/133] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:18 2022] GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12 => generated 1366 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:54:19.435094 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-01f511a0-64f5-44e2-88c3-6cdadf6d479a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:19.438572 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-01f511a0-64f5-44e2-88c3-6cdadf6d479a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: f3ba81ef-4875-4ba4-94e0-c8275bfcf252] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:19.439984 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-420c900c-f2ac-4221-a1c3-5672f4748e43 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:19.440591 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-420c900c-f2ac-4221-a1c3-5672f4748e43 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:19.441718 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-420c900c-f2ac-4221-a1c3-5672f4748e43 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:19.442831 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-420c900c-f2ac-4221-a1c3-5672f4748e43 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:19.443705 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-420c900c-f2ac-4221-a1c3-5672f4748e43 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:19.444279 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-420c900c-f2ac-4221-a1c3-5672f4748e43 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:19.463425 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-01f511a0-64f5-44e2-88c3-6cdadf6d479a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:19.465083 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-01f511a0-64f5-44e2-88c3-6cdadf6d479a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:19.465891 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-01f511a0-64f5-44e2-88c3-6cdadf6d479a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:19.467354 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-01f511a0-64f5-44e2-88c3-6cdadf6d479a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:19.470422 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-01f511a0-64f5-44e2-88c3-6cdadf6d479a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:19.474340 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-01f511a0-64f5-44e2-88c3-6cdadf6d479a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:19.734241 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-420c900c-f2ac-4221-a1c3-5672f4748e43 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46cf7ae501740869d677d0e9e007041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a7b6a5dc86486682777285fa3295ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:19.769111 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-420c900c-f2ac-4221-a1c3-5672f4748e43 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] 10.222.0.26 "GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9" status: 200 len: 1501 microversion: 2.1 time: 0.373735 Sep 12 23:54:19.772123 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 65/134] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:19 2022] GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9 => generated 1501 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:54:19.800879 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-01f511a0-64f5-44e2-88c3-6cdadf6d479a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:19.831110 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-01f511a0-64f5-44e2-88c3-6cdadf6d479a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252" status: 200 len: 1521 microversion: 2.1 time: 0.406348 Sep 12 23:54:19.833131 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 70/135] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:19 2022] GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252 => generated 1521 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:54:20.414247 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d89c483b-21e2-44f0-9171-0595b6fd3424 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:20.415558 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d89c483b-21e2-44f0-9171-0595b6fd3424 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:20.418144 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=82 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:20.425163 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d89c483b-21e2-44f0-9171-0595b6fd3424 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:20.425939 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d89c483b-21e2-44f0-9171-0595b6fd3424 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:20.426543 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d89c483b-21e2-44f0-9171-0595b6fd3424 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:20.427429 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d89c483b-21e2-44f0-9171-0595b6fd3424 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:20.428023 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d89c483b-21e2-44f0-9171-0595b6fd3424 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:20.428638 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d89c483b-21e2-44f0-9171-0595b6fd3424 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:20.444198 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-71c39ef6-e58e-40ef-9ada-71750e5a75f6 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:20.445728 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-71c39ef6-e58e-40ef-9ada-71750e5a75f6 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: 1bdd77eb-4b69-4630-9f49-a1d317bb1e12] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:20.463124 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-71c39ef6-e58e-40ef-9ada-71750e5a75f6 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:20.467150 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-71c39ef6-e58e-40ef-9ada-71750e5a75f6 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:20.467953 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-71c39ef6-e58e-40ef-9ada-71750e5a75f6 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:20.471890 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-71c39ef6-e58e-40ef-9ada-71750e5a75f6 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:20.473123 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-71c39ef6-e58e-40ef-9ada-71750e5a75f6 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:20.473861 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-71c39ef6-e58e-40ef-9ada-71750e5a75f6 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:20.637866 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d89c483b-21e2-44f0-9171-0595b6fd3424 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:20.651459 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d89c483b-21e2-44f0-9171-0595b6fd3424 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:20.655569 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d89c483b-21e2-44f0-9171-0595b6fd3424 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:20.657444 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d89c483b-21e2-44f0-9171-0595b6fd3424 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1408 microversion: 2.20 time: 0.247218 Sep 12 23:54:20.658518 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 66/136] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:54:20 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1408 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:54:20.766334 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-71c39ef6-e58e-40ef-9ada-71750e5a75f6 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:20.787481 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-71c39ef6-e58e-40ef-9ada-71750e5a75f6 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12" status: 200 len: 1366 microversion: 2.1 time: 0.349587 Sep 12 23:54:20.788576 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 71/137] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:20 2022] GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12 => generated 1366 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:54:20.870068 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-00bef63d-bab1-451f-8d73-4c75d47dca68 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:20.870798 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-00bef63d-bab1-451f-8d73-4c75d47dca68 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: f3ba81ef-4875-4ba4-94e0-c8275bfcf252] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:20.877535 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-00bef63d-bab1-451f-8d73-4c75d47dca68 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:20.878285 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-00bef63d-bab1-451f-8d73-4c75d47dca68 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:20.879074 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-00bef63d-bab1-451f-8d73-4c75d47dca68 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:20.880027 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-00bef63d-bab1-451f-8d73-4c75d47dca68 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:20.880878 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-00bef63d-bab1-451f-8d73-4c75d47dca68 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:20.881494 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-00bef63d-bab1-451f-8d73-4c75d47dca68 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:21.210409 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-00bef63d-bab1-451f-8d73-4c75d47dca68 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:21.228640 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-00bef63d-bab1-451f-8d73-4c75d47dca68 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252" status: 200 len: 1521 microversion: 2.1 time: 0.363206 Sep 12 23:54:21.230178 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 67/138] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:20 2022] GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252 => generated 1521 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:54:21.544213 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-57b36213-9665-478a-adb8-40320b99397d tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "35294b32-37a4-41d0-9595-d89f7ce0c5ce"}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:54:21.553086 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-57b36213-9665-478a-adb8-40320b99397d tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] [instance: cab7089c-6860-4148-9dd6-45939ee2c1a9] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:21.580715 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-57b36213-9665-478a-adb8-40320b99397d tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:21.582123 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-57b36213-9665-478a-adb8-40320b99397d tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:21.585939 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-57b36213-9665-478a-adb8-40320b99397d tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:21.591006 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-57b36213-9665-478a-adb8-40320b99397d tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:21.593401 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-57b36213-9665-478a-adb8-40320b99397d tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:21.594710 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-57b36213-9665-478a-adb8-40320b99397d tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:21.689640 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-975657eb-64d4-4a96-bdf1-5494f91ba343 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:21.690745 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-975657eb-64d4-4a96-bdf1-5494f91ba343 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:21.713516 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-975657eb-64d4-4a96-bdf1-5494f91ba343 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:21.719075 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-975657eb-64d4-4a96-bdf1-5494f91ba343 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:21.719843 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-975657eb-64d4-4a96-bdf1-5494f91ba343 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:21.721541 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-975657eb-64d4-4a96-bdf1-5494f91ba343 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:21.722157 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-975657eb-64d4-4a96-bdf1-5494f91ba343 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:21.722898 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-975657eb-64d4-4a96-bdf1-5494f91ba343 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:22.035354 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-975657eb-64d4-4a96-bdf1-5494f91ba343 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:22.052217 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-975657eb-64d4-4a96-bdf1-5494f91ba343 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:22.053945 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-975657eb-64d4-4a96-bdf1-5494f91ba343 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:22.055206 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-975657eb-64d4-4a96-bdf1-5494f91ba343 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1600 microversion: 2.20 time: 0.373617 Sep 12 23:54:22.056321 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 68/139] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:54:21 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1600 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:54:22.062563 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-de0b1839-6e20-46ba-b50b-d57548fb77ab tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:22.063491 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-de0b1839-6e20-46ba-b50b-d57548fb77ab tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: 1bdd77eb-4b69-4630-9f49-a1d317bb1e12] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:22.071521 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-de0b1839-6e20-46ba-b50b-d57548fb77ab tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:22.072645 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-de0b1839-6e20-46ba-b50b-d57548fb77ab tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:22.073223 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-de0b1839-6e20-46ba-b50b-d57548fb77ab tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:22.074788 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-de0b1839-6e20-46ba-b50b-d57548fb77ab tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:22.075466 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-de0b1839-6e20-46ba-b50b-d57548fb77ab tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:22.076022 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-de0b1839-6e20-46ba-b50b-d57548fb77ab tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:22.211316 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-57b36213-9665-478a-adb8-40320b99397d tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] 10.222.0.26 "POST /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.674402 Sep 12 23:54:22.212304 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 72/140] 10.222.0.26 () {60 vars in 1323 bytes} [Mon Sep 12 23:54:21 2022] POST /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9/os-volume_attachments => generated 194 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:54:22.243420 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9e1a547f-2649-45d4-b633-91812290a95d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:22.244420 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9e1a547f-2649-45d4-b633-91812290a95d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:22.264320 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9e1a547f-2649-45d4-b633-91812290a95d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:22.268645 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9e1a547f-2649-45d4-b633-91812290a95d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:22.269364 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9e1a547f-2649-45d4-b633-91812290a95d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:22.273948 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9e1a547f-2649-45d4-b633-91812290a95d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:22.274665 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9e1a547f-2649-45d4-b633-91812290a95d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:22.274971 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9e1a547f-2649-45d4-b633-91812290a95d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:22.284006 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-de0b1839-6e20-46ba-b50b-d57548fb77ab tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:22.301935 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-de0b1839-6e20-46ba-b50b-d57548fb77ab tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12" status: 200 len: 1557 microversion: 2.1 time: 0.243877 Sep 12 23:54:22.304390 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 69/141] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:22 2022] GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12 => generated 1557 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:54:22.336138 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3f39b878-99f9-42a7-a9de-fc5219e508a2 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:22.337421 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3f39b878-99f9-42a7-a9de-fc5219e508a2 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: f3ba81ef-4875-4ba4-94e0-c8275bfcf252] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:22.345120 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3f39b878-99f9-42a7-a9de-fc5219e508a2 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:22.346367 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3f39b878-99f9-42a7-a9de-fc5219e508a2 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:22.347906 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3f39b878-99f9-42a7-a9de-fc5219e508a2 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:22.351411 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3f39b878-99f9-42a7-a9de-fc5219e508a2 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:22.353675 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3f39b878-99f9-42a7-a9de-fc5219e508a2 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:22.354959 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3f39b878-99f9-42a7-a9de-fc5219e508a2 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:22.411644 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9e1a547f-2649-45d4-b633-91812290a95d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.197600 Sep 12 23:54:22.412245 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 73/142] 10.222.0.26 () {60 vars in 1316 bytes} [Mon Sep 12 23:54:22 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65/os-interface => generated 285 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 23:54:22.417051 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4bccedfc-43b3-462d-a262-992ee3d24b0a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:22.417540 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4bccedfc-43b3-462d-a262-992ee3d24b0a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: 1bdd77eb-4b69-4630-9f49-a1d317bb1e12] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:22.439496 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4bccedfc-43b3-462d-a262-992ee3d24b0a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:22.443133 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4bccedfc-43b3-462d-a262-992ee3d24b0a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:22.443840 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4bccedfc-43b3-462d-a262-992ee3d24b0a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:22.444736 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4bccedfc-43b3-462d-a262-992ee3d24b0a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:22.445280 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4bccedfc-43b3-462d-a262-992ee3d24b0a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:22.446000 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4bccedfc-43b3-462d-a262-992ee3d24b0a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:22.571204 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4bccedfc-43b3-462d-a262-992ee3d24b0a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.157843 Sep 12 23:54:22.572490 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 74/143] 10.222.0.26 () {58 vars in 1275 bytes} [Mon Sep 12 23:54:22 2022] GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12/os-interface => generated 285 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:54:22.743070 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3f39b878-99f9-42a7-a9de-fc5219e508a2 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:22.773554 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3f39b878-99f9-42a7-a9de-fc5219e508a2 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252" status: 200 len: 1521 microversion: 2.1 time: 0.464350 Sep 12 23:54:22.776405 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 70/144] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:22 2022] GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252 => generated 1521 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:54:23.800920 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-06ba97ed-b598-4dfd-985a-e0ed03366a2b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:23.801781 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-06ba97ed-b598-4dfd-985a-e0ed03366a2b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: f3ba81ef-4875-4ba4-94e0-c8275bfcf252] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:23.830239 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-06ba97ed-b598-4dfd-985a-e0ed03366a2b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:23.844083 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-06ba97ed-b598-4dfd-985a-e0ed03366a2b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:23.846192 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-06ba97ed-b598-4dfd-985a-e0ed03366a2b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:23.848265 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-06ba97ed-b598-4dfd-985a-e0ed03366a2b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:23.860437 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-06ba97ed-b598-4dfd-985a-e0ed03366a2b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:23.863288 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-06ba97ed-b598-4dfd-985a-e0ed03366a2b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:24.601256 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-06ba97ed-b598-4dfd-985a-e0ed03366a2b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:24.612275 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-06ba97ed-b598-4dfd-985a-e0ed03366a2b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252" status: 200 len: 1521 microversion: 2.1 time: 0.815796 Sep 12 23:54:24.612938 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 75/145] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:23 2022] GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252 => generated 1521 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:54:25.018735 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-f63f3b27-8fe5-4503-97f2-050b3a7194de req-36430065-62d7-421d-af05-61844261eca8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "893ed869-802c-4a92-b7ab-d2aa8324fb65", "tag": "3a5cf7e7-3d44-4786-8d75-99e5d72ef0e0"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:54:25.040702 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-f63f3b27-8fe5-4503-97f2-050b3a7194de req-36430065-62d7-421d-af05-61844261eca8 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:25.043191 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-f63f3b27-8fe5-4503-97f2-050b3a7194de req-36430065-62d7-421d-af05-61844261eca8 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:25.044799 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-f63f3b27-8fe5-4503-97f2-050b3a7194de req-36430065-62d7-421d-af05-61844261eca8 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:25.095709 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-f63f3b27-8fe5-4503-97f2-050b3a7194de req-36430065-62d7-421d-af05-61844261eca8 service nova] Creating event network-changed:3a5cf7e7-3d44-4786-8d75-99e5d72ef0e0 for instance 893ed869-802c-4a92-b7ab-d2aa8324fb65 on hv-cinder-82002 Sep 12 23:54:25.119045 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-f63f3b27-8fe5-4503-97f2-050b3a7194de req-36430065-62d7-421d-af05-61844261eca8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104894 Sep 12 23:54:25.119045 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 71/146] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:54:25.313838 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-64d3a25d-0309-4c6b-ac42-438e6fb4c118 req-97d427a1-893a-4b16-89cd-1287f1f55706 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bdd77eb-4b69-4630-9f49-a1d317bb1e12", "tag": "41507fcf-1ad4-4940-9dad-33c3404dea2d"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:54:25.335861 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-64d3a25d-0309-4c6b-ac42-438e6fb4c118 req-97d427a1-893a-4b16-89cd-1287f1f55706 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:25.336346 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-64d3a25d-0309-4c6b-ac42-438e6fb4c118 req-97d427a1-893a-4b16-89cd-1287f1f55706 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:25.336768 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-64d3a25d-0309-4c6b-ac42-438e6fb4c118 req-97d427a1-893a-4b16-89cd-1287f1f55706 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:25.361291 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-64d3a25d-0309-4c6b-ac42-438e6fb4c118 req-97d427a1-893a-4b16-89cd-1287f1f55706 service nova] Creating event network-changed:41507fcf-1ad4-4940-9dad-33c3404dea2d for instance 1bdd77eb-4b69-4630-9f49-a1d317bb1e12 on hv-cinder-82002 Sep 12 23:54:25.367390 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-64d3a25d-0309-4c6b-ac42-438e6fb4c118 req-97d427a1-893a-4b16-89cd-1287f1f55706 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058966 Sep 12 23:54:25.371850 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 76/147] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 23:54:25.663900 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-74e7c72b-7b05-4322-8cbb-2d57230ca682 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:25.679603 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-74e7c72b-7b05-4322-8cbb-2d57230ca682 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: f3ba81ef-4875-4ba4-94e0-c8275bfcf252] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:25.698241 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-74e7c72b-7b05-4322-8cbb-2d57230ca682 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:25.705216 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-74e7c72b-7b05-4322-8cbb-2d57230ca682 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:25.706120 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-74e7c72b-7b05-4322-8cbb-2d57230ca682 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:25.708720 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-74e7c72b-7b05-4322-8cbb-2d57230ca682 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:25.712123 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-74e7c72b-7b05-4322-8cbb-2d57230ca682 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:25.716239 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-74e7c72b-7b05-4322-8cbb-2d57230ca682 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:25.961375 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-74e7c72b-7b05-4322-8cbb-2d57230ca682 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:25.972281 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-74e7c72b-7b05-4322-8cbb-2d57230ca682 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252" status: 200 len: 1521 microversion: 2.1 time: 0.325436 Sep 12 23:54:25.976372 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 72/148] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:25 2022] GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252 => generated 1521 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:54:27.022118 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3654482f-a9e1-4a87-b0e6-d1ef676333f9 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:27.025842 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3654482f-a9e1-4a87-b0e6-d1ef676333f9 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: f3ba81ef-4875-4ba4-94e0-c8275bfcf252] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:27.055960 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3654482f-a9e1-4a87-b0e6-d1ef676333f9 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:27.063077 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3654482f-a9e1-4a87-b0e6-d1ef676333f9 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:27.065322 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3654482f-a9e1-4a87-b0e6-d1ef676333f9 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:27.069146 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3654482f-a9e1-4a87-b0e6-d1ef676333f9 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:27.070089 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3654482f-a9e1-4a87-b0e6-d1ef676333f9 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:27.071316 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3654482f-a9e1-4a87-b0e6-d1ef676333f9 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:27.719897 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3654482f-a9e1-4a87-b0e6-d1ef676333f9 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:27.731925 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3654482f-a9e1-4a87-b0e6-d1ef676333f9 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252" status: 200 len: 1521 microversion: 2.1 time: 0.732470 Sep 12 23:54:27.732313 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 77/149] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:26 2022] GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252 => generated 1521 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:54:28.760292 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ab9d7dff-ca56-4dd7-b7c2-772b4ee5e194 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:28.765132 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ab9d7dff-ca56-4dd7-b7c2-772b4ee5e194 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: f3ba81ef-4875-4ba4-94e0-c8275bfcf252] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:28.777339 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ab9d7dff-ca56-4dd7-b7c2-772b4ee5e194 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:28.788521 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ab9d7dff-ca56-4dd7-b7c2-772b4ee5e194 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:28.789366 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ab9d7dff-ca56-4dd7-b7c2-772b4ee5e194 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:28.790623 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ab9d7dff-ca56-4dd7-b7c2-772b4ee5e194 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:28.791522 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ab9d7dff-ca56-4dd7-b7c2-772b4ee5e194 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:28.791964 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ab9d7dff-ca56-4dd7-b7c2-772b4ee5e194 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:29.076184 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ab9d7dff-ca56-4dd7-b7c2-772b4ee5e194 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:29.091103 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ab9d7dff-ca56-4dd7-b7c2-772b4ee5e194 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252" status: 200 len: 1521 microversion: 2.1 time: 0.338229 Sep 12 23:54:29.092677 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 73/150] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:28 2022] GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252 => generated 1521 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:54:30.115507 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d7b7606d-2139-48dc-836d-74c744e50f0a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:30.116419 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d7b7606d-2139-48dc-836d-74c744e50f0a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: f3ba81ef-4875-4ba4-94e0-c8275bfcf252] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:30.135289 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d7b7606d-2139-48dc-836d-74c744e50f0a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:30.136680 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d7b7606d-2139-48dc-836d-74c744e50f0a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:30.137440 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d7b7606d-2139-48dc-836d-74c744e50f0a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:30.144753 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d7b7606d-2139-48dc-836d-74c744e50f0a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:30.145516 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d7b7606d-2139-48dc-836d-74c744e50f0a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:30.148776 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d7b7606d-2139-48dc-836d-74c744e50f0a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:30.490866 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d7b7606d-2139-48dc-836d-74c744e50f0a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:30.508009 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d7b7606d-2139-48dc-836d-74c744e50f0a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252" status: 200 len: 1521 microversion: 2.1 time: 0.395826 Sep 12 23:54:30.520218 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 78/151] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:30 2022] GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252 => generated 1521 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:54:31.522493 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9c50c2e2-d232-4cb4-8592-14a509d4dd39 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:31.523354 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9c50c2e2-d232-4cb4-8592-14a509d4dd39 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] [instance: cab7089c-6860-4148-9dd6-45939ee2c1a9] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:31.536849 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9c50c2e2-d232-4cb4-8592-14a509d4dd39 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:31.537266 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9c50c2e2-d232-4cb4-8592-14a509d4dd39 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:31.539483 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9c50c2e2-d232-4cb4-8592-14a509d4dd39 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:31.542059 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9c50c2e2-d232-4cb4-8592-14a509d4dd39 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:31.542582 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9c50c2e2-d232-4cb4-8592-14a509d4dd39 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:31.544722 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9c50c2e2-d232-4cb4-8592-14a509d4dd39 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:31.559129 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1df07497-86a0-4235-b08c-dd905c64d5da tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:31.559840 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1df07497-86a0-4235-b08c-dd905c64d5da tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: f3ba81ef-4875-4ba4-94e0-c8275bfcf252] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:31.590963 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1df07497-86a0-4235-b08c-dd905c64d5da tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:31.604490 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1df07497-86a0-4235-b08c-dd905c64d5da tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:31.613275 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1df07497-86a0-4235-b08c-dd905c64d5da tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:31.620574 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1df07497-86a0-4235-b08c-dd905c64d5da tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:31.621617 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1df07497-86a0-4235-b08c-dd905c64d5da tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:31.622568 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1df07497-86a0-4235-b08c-dd905c64d5da tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:31.713376 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:31.746138 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9c50c2e2-d232-4cb4-8592-14a509d4dd39 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] [instance: cab7089c-6860-4148-9dd6-45939ee2c1a9] Going to try to terminate instance {{(pid=126976) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 23:54:32.022838 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9c50c2e2-d232-4cb4-8592-14a509d4dd39 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] 10.222.0.26 "DELETE /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9" status: 204 len: 0 microversion: 2.1 time: 0.503932 Sep 12 23:54:32.024306 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 74/152] 10.222.0.26 () {58 vars in 1239 bytes} [Mon Sep 12 23:54:31 2022] DELETE /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 12 23:54:32.036086 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-60dbc490-8296-4ca3-896f-4cc2bf5e4ca4 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:32.037111 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-60dbc490-8296-4ca3-896f-4cc2bf5e4ca4 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] [instance: cab7089c-6860-4148-9dd6-45939ee2c1a9] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:32.046661 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-60dbc490-8296-4ca3-896f-4cc2bf5e4ca4 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:32.047497 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-60dbc490-8296-4ca3-896f-4cc2bf5e4ca4 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:32.048183 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-60dbc490-8296-4ca3-896f-4cc2bf5e4ca4 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:32.049630 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-60dbc490-8296-4ca3-896f-4cc2bf5e4ca4 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:32.050418 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-60dbc490-8296-4ca3-896f-4cc2bf5e4ca4 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:32.051036 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-60dbc490-8296-4ca3-896f-4cc2bf5e4ca4 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:32.361472 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-1df07497-86a0-4235-b08c-dd905c64d5da tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:32.375503 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1df07497-86a0-4235-b08c-dd905c64d5da tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252" status: 200 len: 1521 microversion: 2.1 time: 0.825851 Sep 12 23:54:32.377219 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 79/153] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:31 2022] GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252 => generated 1521 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:54:32.738904 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-60dbc490-8296-4ca3-896f-4cc2bf5e4ca4 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46cf7ae501740869d677d0e9e007041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a7b6a5dc86486682777285fa3295ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:32.753023 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-60dbc490-8296-4ca3-896f-4cc2bf5e4ca4 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] 10.222.0.26 "GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9" status: 200 len: 1553 microversion: 2.1 time: 0.724145 Sep 12 23:54:32.753690 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 75/154] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:32 2022] GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9 => generated 1553 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:54:33.401619 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-10fb3202-9ef7-40e3-aa62-802636b145fa tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:33.402232 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-10fb3202-9ef7-40e3-aa62-802636b145fa tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: f3ba81ef-4875-4ba4-94e0-c8275bfcf252] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:33.416064 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-10fb3202-9ef7-40e3-aa62-802636b145fa tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:33.416870 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-10fb3202-9ef7-40e3-aa62-802636b145fa tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:33.418156 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-10fb3202-9ef7-40e3-aa62-802636b145fa tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:33.418942 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-10fb3202-9ef7-40e3-aa62-802636b145fa tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:33.419448 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-10fb3202-9ef7-40e3-aa62-802636b145fa tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:33.419884 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-10fb3202-9ef7-40e3-aa62-802636b145fa tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:33.701862 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-10fb3202-9ef7-40e3-aa62-802636b145fa tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:33.714861 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-10fb3202-9ef7-40e3-aa62-802636b145fa tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252" status: 200 len: 1521 microversion: 2.1 time: 0.315868 Sep 12 23:54:33.717667 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 80/155] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:33 2022] GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252 => generated 1521 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:54:33.780663 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a6c1e06b-82e5-4a65-bbbf-9727d35af66f tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:33.781395 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a6c1e06b-82e5-4a65-bbbf-9727d35af66f tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] [instance: cab7089c-6860-4148-9dd6-45939ee2c1a9] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:33.807700 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a6c1e06b-82e5-4a65-bbbf-9727d35af66f tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:33.808204 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a6c1e06b-82e5-4a65-bbbf-9727d35af66f tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:33.808639 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a6c1e06b-82e5-4a65-bbbf-9727d35af66f tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:33.818447 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a6c1e06b-82e5-4a65-bbbf-9727d35af66f tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:33.819151 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a6c1e06b-82e5-4a65-bbbf-9727d35af66f tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:33.823779 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a6c1e06b-82e5-4a65-bbbf-9727d35af66f tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:34.423730 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a6c1e06b-82e5-4a65-bbbf-9727d35af66f tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46cf7ae501740869d677d0e9e007041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a7b6a5dc86486682777285fa3295ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:34.434124 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:34.459304 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a6c1e06b-82e5-4a65-bbbf-9727d35af66f tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] 10.222.0.26 "GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9" status: 200 len: 1553 microversion: 2.1 time: 0.682741 Sep 12 23:54:34.460091 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 76/156] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:33 2022] GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9 => generated 1553 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:54:34.773470 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a7e6b2ee-415a-4f70-b88c-0e1887ef3b48 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:34.776050 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a7e6b2ee-415a-4f70-b88c-0e1887ef3b48 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: f3ba81ef-4875-4ba4-94e0-c8275bfcf252] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:34.801514 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a7e6b2ee-415a-4f70-b88c-0e1887ef3b48 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:34.802719 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a7e6b2ee-415a-4f70-b88c-0e1887ef3b48 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:34.805301 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a7e6b2ee-415a-4f70-b88c-0e1887ef3b48 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:34.807277 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a7e6b2ee-415a-4f70-b88c-0e1887ef3b48 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:34.808272 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a7e6b2ee-415a-4f70-b88c-0e1887ef3b48 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:34.809006 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a7e6b2ee-415a-4f70-b88c-0e1887ef3b48 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:35.503255 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8c023d48-e2ce-453e-b3e5-3ff8be58bbfc tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:35.503929 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-8c023d48-e2ce-453e-b3e5-3ff8be58bbfc tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] [instance: cab7089c-6860-4148-9dd6-45939ee2c1a9] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:35.528067 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8c023d48-e2ce-453e-b3e5-3ff8be58bbfc tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:35.530763 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8c023d48-e2ce-453e-b3e5-3ff8be58bbfc tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:35.531508 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8c023d48-e2ce-453e-b3e5-3ff8be58bbfc tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:35.537605 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8c023d48-e2ce-453e-b3e5-3ff8be58bbfc tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:35.538625 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8c023d48-e2ce-453e-b3e5-3ff8be58bbfc tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:35.539365 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8c023d48-e2ce-453e-b3e5-3ff8be58bbfc tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:35.567930 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a7e6b2ee-415a-4f70-b88c-0e1887ef3b48 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:35.611160 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a7e6b2ee-415a-4f70-b88c-0e1887ef3b48 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252" status: 200 len: 1521 microversion: 2.1 time: 0.849890 Sep 12 23:54:35.618040 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 81/157] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:34 2022] GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252 => generated 1521 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:54:35.955120 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8c023d48-e2ce-453e-b3e5-3ff8be58bbfc tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46cf7ae501740869d677d0e9e007041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a7b6a5dc86486682777285fa3295ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:35.972318 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-8c023d48-e2ce-453e-b3e5-3ff8be58bbfc tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] 10.222.0.26 "GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9" status: 200 len: 1553 microversion: 2.1 time: 0.473359 Sep 12 23:54:35.972948 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 77/158] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:35 2022] GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9 => generated 1553 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:54:36.320239 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-84cc07c4-c48e-4c4f-a1fa-2d866d82d9e3 req-c32dc99a-1605-41f5-8be3-c7a190a08391 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cab7089c-6860-4148-9dd6-45939ee2c1a9", "name": "network-vif-deleted", "tag": "1c215802-5c5c-403a-8d38-46981edefef8"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:54:36.351073 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-84cc07c4-c48e-4c4f-a1fa-2d866d82d9e3 req-c32dc99a-1605-41f5-8be3-c7a190a08391 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:36.351582 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-84cc07c4-c48e-4c4f-a1fa-2d866d82d9e3 req-c32dc99a-1605-41f5-8be3-c7a190a08391 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:36.352490 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-84cc07c4-c48e-4c4f-a1fa-2d866d82d9e3 req-c32dc99a-1605-41f5-8be3-c7a190a08391 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:36.388571 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-84cc07c4-c48e-4c4f-a1fa-2d866d82d9e3 req-c32dc99a-1605-41f5-8be3-c7a190a08391 service nova] Creating event network-vif-deleted:1c215802-5c5c-403a-8d38-46981edefef8 for instance cab7089c-6860-4148-9dd6-45939ee2c1a9 on hv-cinder-82002 Sep 12 23:54:36.399979 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-84cc07c4-c48e-4c4f-a1fa-2d866d82d9e3 req-c32dc99a-1605-41f5-8be3-c7a190a08391 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093407 Sep 12 23:54:36.407453 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 82/159] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:54:36.667596 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-21b81dd4-0219-4cee-ac65-98b499a1103e tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:36.670594 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-21b81dd4-0219-4cee-ac65-98b499a1103e tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: f3ba81ef-4875-4ba4-94e0-c8275bfcf252] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:36.684245 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-21b81dd4-0219-4cee-ac65-98b499a1103e tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:36.685221 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-21b81dd4-0219-4cee-ac65-98b499a1103e tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:36.685853 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-21b81dd4-0219-4cee-ac65-98b499a1103e tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:36.686738 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-21b81dd4-0219-4cee-ac65-98b499a1103e tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:36.687429 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-21b81dd4-0219-4cee-ac65-98b499a1103e tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:36.688011 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-21b81dd4-0219-4cee-ac65-98b499a1103e tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:37.043087 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-88a54da0-10c7-416e-9cc0-fa1ecc586053 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:37.050892 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-88a54da0-10c7-416e-9cc0-fa1ecc586053 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] [instance: cab7089c-6860-4148-9dd6-45939ee2c1a9] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:37.054413 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-21b81dd4-0219-4cee-ac65-98b499a1103e tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:37.077588 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-88a54da0-10c7-416e-9cc0-fa1ecc586053 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:37.077836 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-88a54da0-10c7-416e-9cc0-fa1ecc586053 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:37.078630 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-88a54da0-10c7-416e-9cc0-fa1ecc586053 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:37.079901 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-88a54da0-10c7-416e-9cc0-fa1ecc586053 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:37.080718 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-88a54da0-10c7-416e-9cc0-fa1ecc586053 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:37.083583 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-88a54da0-10c7-416e-9cc0-fa1ecc586053 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:37.106893 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-21b81dd4-0219-4cee-ac65-98b499a1103e tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252" status: 200 len: 1521 microversion: 2.1 time: 0.444040 Sep 12 23:54:37.108901 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 78/160] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:36 2022] GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252 => generated 1521 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:54:37.295377 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-88a54da0-10c7-416e-9cc0-fa1ecc586053 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46cf7ae501740869d677d0e9e007041', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a7b6a5dc86486682777285fa3295ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:37.328142 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-88a54da0-10c7-416e-9cc0-fa1ecc586053 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] 10.222.0.26 "GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9" status: 200 len: 1346 microversion: 2.1 time: 0.304671 Sep 12 23:54:37.332084 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 83/161] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:37 2022] GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9 => generated 1346 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:54:38.136656 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-110a5fee-713e-4b32-a0e7-044b5615c711 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:38.137351 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-110a5fee-713e-4b32-a0e7-044b5615c711 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: f3ba81ef-4875-4ba4-94e0-c8275bfcf252] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:38.155637 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-110a5fee-713e-4b32-a0e7-044b5615c711 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:38.156262 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-110a5fee-713e-4b32-a0e7-044b5615c711 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:38.159415 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-110a5fee-713e-4b32-a0e7-044b5615c711 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:38.162872 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-110a5fee-713e-4b32-a0e7-044b5615c711 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:38.165496 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-110a5fee-713e-4b32-a0e7-044b5615c711 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:38.169505 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-110a5fee-713e-4b32-a0e7-044b5615c711 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:38.356874 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-81a36720-1e21-4c93-bb26-b649551ff48e tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:38.357545 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-81a36720-1e21-4c93-bb26-b649551ff48e tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] [instance: cab7089c-6860-4148-9dd6-45939ee2c1a9] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:38.370608 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-81a36720-1e21-4c93-bb26-b649551ff48e tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:38.378478 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-81a36720-1e21-4c93-bb26-b649551ff48e tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:38.379144 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-81a36720-1e21-4c93-bb26-b649551ff48e tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:38.380175 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-81a36720-1e21-4c93-bb26-b649551ff48e tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:38.380834 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-81a36720-1e21-4c93-bb26-b649551ff48e tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:38.381451 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-81a36720-1e21-4c93-bb26-b649551ff48e tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:38.415482 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-81a36720-1e21-4c93-bb26-b649551ff48e tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] HTTP exception thrown: Instance cab7089c-6860-4148-9dd6-45939ee2c1a9 could not be found. Sep 12 23:54:38.454728 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-81a36720-1e21-4c93-bb26-b649551ff48e tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Request method failure captured: Sep 12 23:54:38.454728 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: request: GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9 HTTP/1.1 Sep 12 23:54:38.454728 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept: application/json Sep 12 23:54:38.454728 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Sep 12 23:54:38.454728 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Connection: close Sep 12 23:54:38.454728 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Length: 0 Sep 12 23:54:38.454728 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Type: application/json Sep 12 23:54:38.454728 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Host: 10.222.0.26 Sep 12 23:54:38.454728 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Sep 12 23:54:38.454728 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Sep 12 23:54:38.454728 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjH8ZsuLp-theRKh59oE-u29AQgfXb5-aV9t-D-De3S-howCzJ4ExVWlPmL7OSpigQoDK65rktP7dfLMOeRhc8T7e92jsUnNgIolIGPxryk0m-oTE6MdLZsj-IMBPtXqw1KxMa-ZhM-vV9JHiHziN085H4EEglUGnnid4hlK85DGSmEFQ Sep 12 23:54:38.454728 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Sep 12 23:54:38.454728 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Sep 12 23:54:38.454728 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Sep 12 23:54:38.454728 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Sep 12 23:54:38.454728 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Sep 12 23:54:38.454728 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Sep 12 23:54:38.454728 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Id: 58a7b6a5dc86486682777285fa3295ac Sep 12 23:54:38.454728 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-DeleteServersTestJSON-1096108465 Sep 12 23:54:38.454728 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Role: member,reader Sep 12 23:54:38.454728 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Roles: member,reader Sep 12 23:54:38.457230 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/58a7b6a5dc86486682777285fa3295ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/58a7b6a5dc86486682777285fa3295ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_58a7b6a5dc86486682777285fa3295ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/58a7b6a5dc86486682777285fa3295ac"}]}] Sep 12 23:54:38.457230 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-DeleteServersTestJSON-1096108465 Sep 12 23:54:38.457230 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Id: 58a7b6a5dc86486682777285fa3295ac Sep 12 23:54:38.457230 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-DeleteServersTestJSON-1096108465 Sep 12 23:54:38.457230 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User: tempest-DeleteServersTestJSON-1096108465-project Sep 12 23:54:38.457230 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Sep 12 23:54:38.457230 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Sep 12 23:54:38.457230 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Id: d46cf7ae501740869d677d0e9e007041 Sep 12 23:54:38.457230 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-DeleteServersTestJSON-1096108465-project Sep 12 23:54:38.457230 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: method: > Sep 12 23:54:38.457230 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: exception: Instance cab7089c-6860-4148-9dd6-45939ee2c1a9 could not be found. Sep 12 23:54:38.457230 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: action_args: {'id': 'cab7089c-6860-4148-9dd6-45939ee2c1a9'} Sep 12 23:54:38.459301 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:54:38.459301 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:54:38.459301 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:54:38.459301 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:54:38.459301 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:54:38.459301 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:54:38.459301 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:54:38.459301 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:54:38.459301 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:54:38.459301 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:54:38.459301 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cab7089c-6860-4148-9dd6-45939ee2c1a9 could not be found. Sep 12 23:54:38.459301 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:54:38.459301 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:54:38.459301 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:54:38.459301 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:54:38.459301 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:54:38.459301 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:54:38.459301 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:54:38.459301 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:54:38.459301 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:54:38.465367 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:54:38.465367 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 23:54:38.465367 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 23:54:38.465367 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:54:38.465367 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:54:38.465367 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:54:38.465367 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:54:38.465367 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cab7089c-6860-4148-9dd6-45939ee2c1a9 could not be found. Sep 12 23:54:38.465367 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:54:38.465367 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:54:38.465367 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:54:38.465367 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:54:38.465367 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:54:38.465367 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:54:38.465367 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:54:38.465367 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:54:38.465367 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cab7089c-6860-4148-9dd6-45939ee2c1a9 could not be found. Sep 12 23:54:38.465367 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:54:38.469999 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-81a36720-1e21-4c93-bb26-b649551ff48e tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Returning 404 to user: Instance cab7089c-6860-4148-9dd6-45939ee2c1a9 could not be found. {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:54:38.469999 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-81a36720-1e21-4c93-bb26-b649551ff48e tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] 10.222.0.26 "GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9" status: 404 len: 111 microversion: 2.1 time: 0.105667 Sep 12 23:54:38.469999 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 84/162] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:38 2022] GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 12 23:54:38.553906 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-110a5fee-713e-4b32-a0e7-044b5615c711 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:38.593332 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-110a5fee-713e-4b32-a0e7-044b5615c711 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252" status: 200 len: 1521 microversion: 2.1 time: 0.462522 Sep 12 23:54:38.597200 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 79/163] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:38 2022] GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252 => generated 1521 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:54:38.970481 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0e502c13-3938-403b-ae1b-75c2acc8d2c9 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:38.973087 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0e502c13-3938-403b-ae1b-75c2acc8d2c9 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] [instance: cab7089c-6860-4148-9dd6-45939ee2c1a9] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:38.980495 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0e502c13-3938-403b-ae1b-75c2acc8d2c9 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:38.981340 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0e502c13-3938-403b-ae1b-75c2acc8d2c9 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:38.981961 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0e502c13-3938-403b-ae1b-75c2acc8d2c9 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:38.982886 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0e502c13-3938-403b-ae1b-75c2acc8d2c9 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:38.984156 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0e502c13-3938-403b-ae1b-75c2acc8d2c9 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:38.984817 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0e502c13-3938-403b-ae1b-75c2acc8d2c9 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:39.007442 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-0e502c13-3938-403b-ae1b-75c2acc8d2c9 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] HTTP exception thrown: Instance cab7089c-6860-4148-9dd6-45939ee2c1a9 could not be found. Sep 12 23:54:39.013979 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0e502c13-3938-403b-ae1b-75c2acc8d2c9 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Request method failure captured: Sep 12 23:54:39.013979 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: request: GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9/os-volume_attachments HTTP/1.1 Sep 12 23:54:39.013979 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept: application/json Sep 12 23:54:39.013979 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Sep 12 23:54:39.013979 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Connection: close Sep 12 23:54:39.013979 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Length: 0 Sep 12 23:54:39.013979 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Type: application/json Sep 12 23:54:39.013979 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Host: 10.222.0.26 Sep 12 23:54:39.013979 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Sep 12 23:54:39.013979 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Sep 12 23:54:39.013979 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjH8ZsuLp-theRKh59oE-u29AQgfXb5-aV9t-D-De3S-howCzJ4ExVWlPmL7OSpigQoDK65rktP7dfLMOeRhc8T7e92jsUnNgIolIGPxryk0m-oTE6MdLZsj-IMBPtXqw1KxMa-ZhM-vV9JHiHziN085H4EEglUGnnid4hlK85DGSmEFQ Sep 12 23:54:39.013979 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Sep 12 23:54:39.013979 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Sep 12 23:54:39.013979 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Sep 12 23:54:39.013979 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Sep 12 23:54:39.013979 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Sep 12 23:54:39.013979 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Sep 12 23:54:39.013979 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Id: 58a7b6a5dc86486682777285fa3295ac Sep 12 23:54:39.013979 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-DeleteServersTestJSON-1096108465 Sep 12 23:54:39.013979 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Role: member,reader Sep 12 23:54:39.013979 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Roles: member,reader Sep 12 23:54:39.015268 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/58a7b6a5dc86486682777285fa3295ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/58a7b6a5dc86486682777285fa3295ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_58a7b6a5dc86486682777285fa3295ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/58a7b6a5dc86486682777285fa3295ac"}]}] Sep 12 23:54:39.015268 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-DeleteServersTestJSON-1096108465 Sep 12 23:54:39.015268 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Id: 58a7b6a5dc86486682777285fa3295ac Sep 12 23:54:39.015268 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-DeleteServersTestJSON-1096108465 Sep 12 23:54:39.015268 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User: tempest-DeleteServersTestJSON-1096108465-project Sep 12 23:54:39.015268 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Sep 12 23:54:39.015268 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Sep 12 23:54:39.015268 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Id: d46cf7ae501740869d677d0e9e007041 Sep 12 23:54:39.015268 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-DeleteServersTestJSON-1096108465-project Sep 12 23:54:39.015268 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: method: > Sep 12 23:54:39.015268 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: exception: Instance cab7089c-6860-4148-9dd6-45939ee2c1a9 could not be found. Sep 12 23:54:39.015268 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: action_args: {'server_id': 'cab7089c-6860-4148-9dd6-45939ee2c1a9'} Sep 12 23:54:39.015935 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:54:39.015935 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:54:39.015935 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:54:39.015935 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:54:39.015935 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:54:39.015935 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:54:39.015935 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:54:39.015935 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:54:39.015935 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:54:39.015935 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:54:39.015935 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cab7089c-6860-4148-9dd6-45939ee2c1a9 could not be found. Sep 12 23:54:39.015935 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:54:39.015935 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:54:39.015935 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:54:39.015935 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:54:39.015935 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:54:39.015935 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:54:39.015935 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:54:39.015935 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:54:39.015935 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:54:39.017023 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:54:39.017023 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 12 23:54:39.017023 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 12 23:54:39.017023 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 12 23:54:39.017023 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 12 23:54:39.017023 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 12 23:54:39.017023 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 12 23:54:39.017023 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:54:39.017023 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:54:39.017023 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cab7089c-6860-4148-9dd6-45939ee2c1a9 could not be found. Sep 12 23:54:39.017023 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:54:39.017023 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:54:39.017023 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:54:39.017023 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:54:39.017023 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:54:39.017023 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:54:39.017023 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:54:39.017023 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:54:39.017023 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cab7089c-6860-4148-9dd6-45939ee2c1a9 could not be found. Sep 12 23:54:39.017023 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:54:39.020709 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0e502c13-3938-403b-ae1b-75c2acc8d2c9 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Returning 404 to user: Instance cab7089c-6860-4148-9dd6-45939ee2c1a9 could not be found. {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:54:39.022114 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0e502c13-3938-403b-ae1b-75c2acc8d2c9 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] 10.222.0.26 "GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.055851 Sep 12 23:54:39.027027 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 85/164] 10.222.0.26 () {58 vars in 1302 bytes} [Mon Sep 12 23:54:38 2022] GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9/os-volume_attachments => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 12 23:54:39.633452 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8525c0a1-3da1-424a-bccb-60d70e9a1ccf tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:39.634100 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-8525c0a1-3da1-424a-bccb-60d70e9a1ccf tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: f3ba81ef-4875-4ba4-94e0-c8275bfcf252] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:39.645458 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8525c0a1-3da1-424a-bccb-60d70e9a1ccf tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:39.647278 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8525c0a1-3da1-424a-bccb-60d70e9a1ccf tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:39.648853 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8525c0a1-3da1-424a-bccb-60d70e9a1ccf tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:39.651049 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8525c0a1-3da1-424a-bccb-60d70e9a1ccf tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:39.652112 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8525c0a1-3da1-424a-bccb-60d70e9a1ccf tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:39.653140 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8525c0a1-3da1-424a-bccb-60d70e9a1ccf tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:39.932913 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8525c0a1-3da1-424a-bccb-60d70e9a1ccf tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:39.949026 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-8525c0a1-3da1-424a-bccb-60d70e9a1ccf tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252" status: 200 len: 1521 microversion: 2.1 time: 0.319906 Sep 12 23:54:39.950951 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 80/165] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:39 2022] GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252 => generated 1521 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:54:40.532205 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-74df66e9-2d6e-4049-92d0-19dc2a2be273 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:40.533674 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-74df66e9-2d6e-4049-92d0-19dc2a2be273 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] [instance: cab7089c-6860-4148-9dd6-45939ee2c1a9] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:40.545003 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-74df66e9-2d6e-4049-92d0-19dc2a2be273 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:40.546047 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-74df66e9-2d6e-4049-92d0-19dc2a2be273 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:40.546885 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-74df66e9-2d6e-4049-92d0-19dc2a2be273 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:40.547931 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-74df66e9-2d6e-4049-92d0-19dc2a2be273 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:40.548625 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-74df66e9-2d6e-4049-92d0-19dc2a2be273 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:40.549328 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-74df66e9-2d6e-4049-92d0-19dc2a2be273 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:40.570809 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-74df66e9-2d6e-4049-92d0-19dc2a2be273 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] HTTP exception thrown: Instance cab7089c-6860-4148-9dd6-45939ee2c1a9 could not be found. Sep 12 23:54:40.573321 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-74df66e9-2d6e-4049-92d0-19dc2a2be273 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Request method failure captured: Sep 12 23:54:40.573321 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: request: DELETE /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9 HTTP/1.1 Sep 12 23:54:40.573321 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept: application/json Sep 12 23:54:40.573321 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Sep 12 23:54:40.573321 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Connection: close Sep 12 23:54:40.573321 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Length: 0 Sep 12 23:54:40.573321 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Type: application/json Sep 12 23:54:40.573321 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Host: 10.222.0.26 Sep 12 23:54:40.573321 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Sep 12 23:54:40.573321 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Sep 12 23:54:40.573321 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjH8ZsuLp-theRKh59oE-u29AQgfXb5-aV9t-D-De3S-howCzJ4ExVWlPmL7OSpigQoDK65rktP7dfLMOeRhc8T7e92jsUnNgIolIGPxryk0m-oTE6MdLZsj-IMBPtXqw1KxMa-ZhM-vV9JHiHziN085H4EEglUGnnid4hlK85DGSmEFQ Sep 12 23:54:40.573321 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Sep 12 23:54:40.573321 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Sep 12 23:54:40.573321 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Sep 12 23:54:40.573321 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Sep 12 23:54:40.573321 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Sep 12 23:54:40.573321 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Sep 12 23:54:40.573321 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Id: 58a7b6a5dc86486682777285fa3295ac Sep 12 23:54:40.573321 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-DeleteServersTestJSON-1096108465 Sep 12 23:54:40.573321 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Role: member,reader Sep 12 23:54:40.573321 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Roles: member,reader Sep 12 23:54:40.574670 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/58a7b6a5dc86486682777285fa3295ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/58a7b6a5dc86486682777285fa3295ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_58a7b6a5dc86486682777285fa3295ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/58a7b6a5dc86486682777285fa3295ac"}]}] Sep 12 23:54:40.574670 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-DeleteServersTestJSON-1096108465 Sep 12 23:54:40.574670 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Id: 58a7b6a5dc86486682777285fa3295ac Sep 12 23:54:40.574670 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-DeleteServersTestJSON-1096108465 Sep 12 23:54:40.574670 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User: tempest-DeleteServersTestJSON-1096108465-project Sep 12 23:54:40.574670 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Sep 12 23:54:40.574670 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Sep 12 23:54:40.574670 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Id: d46cf7ae501740869d677d0e9e007041 Sep 12 23:54:40.574670 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-DeleteServersTestJSON-1096108465-project Sep 12 23:54:40.574670 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: method: > Sep 12 23:54:40.574670 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: exception: Instance cab7089c-6860-4148-9dd6-45939ee2c1a9 could not be found. Sep 12 23:54:40.574670 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: action_args: {'id': 'cab7089c-6860-4148-9dd6-45939ee2c1a9'} Sep 12 23:54:40.576673 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:54:40.576673 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:54:40.576673 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:54:40.576673 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:54:40.576673 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:54:40.576673 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:54:40.576673 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:54:40.576673 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:54:40.576673 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:54:40.576673 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:54:40.576673 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cab7089c-6860-4148-9dd6-45939ee2c1a9 could not be found. Sep 12 23:54:40.576673 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:54:40.576673 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:54:40.576673 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:54:40.576673 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:54:40.576673 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:54:40.576673 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:54:40.576673 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:54:40.576673 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:54:40.576673 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:54:40.578030 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:54:40.578030 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 12 23:54:40.578030 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 12 23:54:40.578030 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 12 23:54:40.578030 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 12 23:54:40.578030 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:54:40.578030 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:54:40.578030 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:54:40.578030 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:54:40.578030 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cab7089c-6860-4148-9dd6-45939ee2c1a9 could not be found. Sep 12 23:54:40.578030 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:54:40.578030 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:54:40.578030 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:54:40.578030 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:54:40.578030 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:54:40.578030 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:54:40.578030 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:54:40.578030 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:54:40.578030 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cab7089c-6860-4148-9dd6-45939ee2c1a9 could not be found. Sep 12 23:54:40.578030 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:54:40.581839 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-74df66e9-2d6e-4049-92d0-19dc2a2be273 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Returning 404 to user: Instance cab7089c-6860-4148-9dd6-45939ee2c1a9 could not be found. {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:54:40.582796 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-74df66e9-2d6e-4049-92d0-19dc2a2be273 tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] 10.222.0.26 "DELETE /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9" status: 404 len: 111 microversion: 2.1 time: 0.055408 Sep 12 23:54:40.583762 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 86/166] 10.222.0.26 () {58 vars in 1239 bytes} [Mon Sep 12 23:54:40 2022] DELETE /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:54:40.595639 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e200df4d-e2a7-4ac1-a7cc-efc5c551de5a tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:40.597866 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e200df4d-e2a7-4ac1-a7cc-efc5c551de5a tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] [instance: cab7089c-6860-4148-9dd6-45939ee2c1a9] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:40.606067 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e200df4d-e2a7-4ac1-a7cc-efc5c551de5a tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:40.607488 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e200df4d-e2a7-4ac1-a7cc-efc5c551de5a tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:40.608104 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e200df4d-e2a7-4ac1-a7cc-efc5c551de5a tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:40.609218 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e200df4d-e2a7-4ac1-a7cc-efc5c551de5a tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:40.609896 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e200df4d-e2a7-4ac1-a7cc-efc5c551de5a tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:40.611076 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e200df4d-e2a7-4ac1-a7cc-efc5c551de5a tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:40.628703 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-e200df4d-e2a7-4ac1-a7cc-efc5c551de5a tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] HTTP exception thrown: Instance cab7089c-6860-4148-9dd6-45939ee2c1a9 could not be found. Sep 12 23:54:40.634846 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e200df4d-e2a7-4ac1-a7cc-efc5c551de5a tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Request method failure captured: Sep 12 23:54:40.634846 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: request: GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9 HTTP/1.1 Sep 12 23:54:40.634846 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Accept: application/json Sep 12 23:54:40.634846 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Sep 12 23:54:40.634846 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Connection: close Sep 12 23:54:40.634846 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Content-Length: 0 Sep 12 23:54:40.634846 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Content-Type: application/json Sep 12 23:54:40.634846 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Host: 10.222.0.26 Sep 12 23:54:40.634846 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Sep 12 23:54:40.634846 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Sep 12 23:54:40.634846 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjH8ZsuLp-theRKh59oE-u29AQgfXb5-aV9t-D-De3S-howCzJ4ExVWlPmL7OSpigQoDK65rktP7dfLMOeRhc8T7e92jsUnNgIolIGPxryk0m-oTE6MdLZsj-IMBPtXqw1KxMa-ZhM-vV9JHiHziN085H4EEglUGnnid4hlK85DGSmEFQ Sep 12 23:54:40.634846 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Sep 12 23:54:40.634846 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Sep 12 23:54:40.634846 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Sep 12 23:54:40.634846 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Sep 12 23:54:40.634846 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Sep 12 23:54:40.634846 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Sep 12 23:54:40.634846 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Id: 58a7b6a5dc86486682777285fa3295ac Sep 12 23:54:40.634846 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-DeleteServersTestJSON-1096108465 Sep 12 23:54:40.634846 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Role: member,reader Sep 12 23:54:40.634846 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Roles: member,reader Sep 12 23:54:40.636567 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/58a7b6a5dc86486682777285fa3295ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/58a7b6a5dc86486682777285fa3295ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_58a7b6a5dc86486682777285fa3295ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/58a7b6a5dc86486682777285fa3295ac"}]}] Sep 12 23:54:40.636567 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-DeleteServersTestJSON-1096108465 Sep 12 23:54:40.636567 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant-Id: 58a7b6a5dc86486682777285fa3295ac Sep 12 23:54:40.636567 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-DeleteServersTestJSON-1096108465 Sep 12 23:54:40.636567 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User: tempest-DeleteServersTestJSON-1096108465-project Sep 12 23:54:40.636567 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Sep 12 23:54:40.636567 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Sep 12 23:54:40.636567 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Id: d46cf7ae501740869d677d0e9e007041 Sep 12 23:54:40.636567 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-DeleteServersTestJSON-1096108465-project Sep 12 23:54:40.636567 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: method: > Sep 12 23:54:40.636567 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: exception: Instance cab7089c-6860-4148-9dd6-45939ee2c1a9 could not be found. Sep 12 23:54:40.636567 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: action_args: {'id': 'cab7089c-6860-4148-9dd6-45939ee2c1a9'} Sep 12 23:54:40.637189 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:54:40.637189 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:54:40.637189 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:54:40.637189 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:54:40.637189 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:54:40.637189 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:54:40.637189 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:54:40.637189 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:54:40.637189 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:54:40.637189 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:54:40.637189 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cab7089c-6860-4148-9dd6-45939ee2c1a9 could not be found. Sep 12 23:54:40.637189 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:54:40.637189 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:54:40.637189 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:54:40.637189 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:54:40.637189 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:54:40.637189 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:54:40.637189 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:54:40.637189 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:54:40.637189 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:54:40.638219 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:54:40.638219 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 23:54:40.638219 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 23:54:40.638219 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:54:40.638219 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:54:40.638219 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:54:40.638219 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:54:40.638219 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cab7089c-6860-4148-9dd6-45939ee2c1a9 could not be found. Sep 12 23:54:40.638219 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:54:40.638219 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:54:40.638219 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:54:40.638219 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:54:40.638219 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:54:40.638219 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:54:40.638219 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:54:40.638219 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:54:40.638219 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cab7089c-6860-4148-9dd6-45939ee2c1a9 could not be found. Sep 12 23:54:40.638219 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:54:40.641387 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e200df4d-e2a7-4ac1-a7cc-efc5c551de5a tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] Returning 404 to user: Instance cab7089c-6860-4148-9dd6-45939ee2c1a9 could not be found. {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:54:40.643073 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e200df4d-e2a7-4ac1-a7cc-efc5c551de5a tempest-DeleteServersTestJSON-1096108465 tempest-DeleteServersTestJSON-1096108465-project] 10.222.0.26 "GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9" status: 404 len: 111 microversion: 2.1 time: 0.053326 Sep 12 23:54:40.644035 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 81/167] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:40 2022] GET /compute/v2.1/servers/cab7089c-6860-4148-9dd6-45939ee2c1a9 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:54:40.996789 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3cf6e485-b1f8-4470-bed6-d192f23327e9 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:40.997737 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3cf6e485-b1f8-4470-bed6-d192f23327e9 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: f3ba81ef-4875-4ba4-94e0-c8275bfcf252] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:41.008270 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3cf6e485-b1f8-4470-bed6-d192f23327e9 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:41.010653 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3cf6e485-b1f8-4470-bed6-d192f23327e9 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:41.013563 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3cf6e485-b1f8-4470-bed6-d192f23327e9 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:41.018143 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3cf6e485-b1f8-4470-bed6-d192f23327e9 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:41.019011 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3cf6e485-b1f8-4470-bed6-d192f23327e9 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:41.019735 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3cf6e485-b1f8-4470-bed6-d192f23327e9 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:41.829107 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3cf6e485-b1f8-4470-bed6-d192f23327e9 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:41.876122 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3cf6e485-b1f8-4470-bed6-d192f23327e9 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252" status: 200 len: 1521 microversion: 2.1 time: 0.880370 Sep 12 23:54:41.880033 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 87/168] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:40 2022] GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252 => generated 1521 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:54:42.904493 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-18c145ab-3d58-4574-b16b-2c63ade46ca5 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:42.905902 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-18c145ab-3d58-4574-b16b-2c63ade46ca5 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: f3ba81ef-4875-4ba4-94e0-c8275bfcf252] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:42.936064 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-18c145ab-3d58-4574-b16b-2c63ade46ca5 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:42.939792 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-18c145ab-3d58-4574-b16b-2c63ade46ca5 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:42.946250 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-18c145ab-3d58-4574-b16b-2c63ade46ca5 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:42.947835 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-18c145ab-3d58-4574-b16b-2c63ade46ca5 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:42.948791 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-18c145ab-3d58-4574-b16b-2c63ade46ca5 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:42.952202 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-18c145ab-3d58-4574-b16b-2c63ade46ca5 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:43.852355 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-18c145ab-3d58-4574-b16b-2c63ade46ca5 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:43.887700 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-18c145ab-3d58-4574-b16b-2c63ade46ca5 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252" status: 200 len: 1521 microversion: 2.1 time: 0.988497 Sep 12 23:54:43.902847 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 82/169] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:42 2022] GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252 => generated 1521 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:54:44.930844 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-6ab993cc-adda-4fee-b219-a6bb967e3bfc tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:44.934417 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-6ab993cc-adda-4fee-b219-a6bb967e3bfc tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: f3ba81ef-4875-4ba4-94e0-c8275bfcf252] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:44.953926 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6ab993cc-adda-4fee-b219-a6bb967e3bfc tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:44.954385 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6ab993cc-adda-4fee-b219-a6bb967e3bfc tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:44.954828 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6ab993cc-adda-4fee-b219-a6bb967e3bfc tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:44.955610 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6ab993cc-adda-4fee-b219-a6bb967e3bfc tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:44.956191 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6ab993cc-adda-4fee-b219-a6bb967e3bfc tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:44.956616 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6ab993cc-adda-4fee-b219-a6bb967e3bfc tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:45.834668 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-6ab993cc-adda-4fee-b219-a6bb967e3bfc tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:45.900651 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-6ab993cc-adda-4fee-b219-a6bb967e3bfc tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252" status: 200 len: 1521 microversion: 2.1 time: 0.963669 Sep 12 23:54:45.901766 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 88/170] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:44 2022] GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252 => generated 1521 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:54:46.926801 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-86141b9e-eec7-43aa-9750-f150e1483805 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:46.927501 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-86141b9e-eec7-43aa-9750-f150e1483805 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: f3ba81ef-4875-4ba4-94e0-c8275bfcf252] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:46.946311 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-86141b9e-eec7-43aa-9750-f150e1483805 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:46.946984 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-86141b9e-eec7-43aa-9750-f150e1483805 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:46.947546 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-86141b9e-eec7-43aa-9750-f150e1483805 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:46.948835 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-86141b9e-eec7-43aa-9750-f150e1483805 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:46.949604 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-86141b9e-eec7-43aa-9750-f150e1483805 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:46.950339 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-86141b9e-eec7-43aa-9750-f150e1483805 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:47.417723 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-86141b9e-eec7-43aa-9750-f150e1483805 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:47.445007 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-86141b9e-eec7-43aa-9750-f150e1483805 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252" status: 200 len: 1521 microversion: 2.1 time: 0.522633 Sep 12 23:54:47.449348 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 83/171] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:46 2022] GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252 => generated 1521 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:54:48.480717 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4f0e32a4-836f-45f5-86da-99e338571bf8 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:48.482134 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4f0e32a4-836f-45f5-86da-99e338571bf8 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: f3ba81ef-4875-4ba4-94e0-c8275bfcf252] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:48.495166 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=44 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:48.504106 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4f0e32a4-836f-45f5-86da-99e338571bf8 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:48.505300 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4f0e32a4-836f-45f5-86da-99e338571bf8 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:48.506031 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4f0e32a4-836f-45f5-86da-99e338571bf8 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:48.509080 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4f0e32a4-836f-45f5-86da-99e338571bf8 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:48.509885 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4f0e32a4-836f-45f5-86da-99e338571bf8 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:48.510538 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4f0e32a4-836f-45f5-86da-99e338571bf8 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:48.827132 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4f0e32a4-836f-45f5-86da-99e338571bf8 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:48.842055 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4f0e32a4-836f-45f5-86da-99e338571bf8 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252" status: 200 len: 1521 microversion: 2.1 time: 0.365371 Sep 12 23:54:48.848190 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 89/172] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:48 2022] GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252 => generated 1521 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:54:49.879332 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9192a08b-3c63-4883-a608-09c7e312bd2c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:49.880271 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9192a08b-3c63-4883-a608-09c7e312bd2c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: f3ba81ef-4875-4ba4-94e0-c8275bfcf252] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:49.928608 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9192a08b-3c63-4883-a608-09c7e312bd2c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:49.937459 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9192a08b-3c63-4883-a608-09c7e312bd2c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:49.938922 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9192a08b-3c63-4883-a608-09c7e312bd2c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:49.944893 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9192a08b-3c63-4883-a608-09c7e312bd2c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:49.948863 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9192a08b-3c63-4883-a608-09c7e312bd2c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:49.955017 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9192a08b-3c63-4883-a608-09c7e312bd2c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:50.497666 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-9192a08b-3c63-4883-a608-09c7e312bd2c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:50.513591 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9192a08b-3c63-4883-a608-09c7e312bd2c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252" status: 200 len: 1521 microversion: 2.1 time: 0.644272 Sep 12 23:54:50.514271 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 84/173] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:49 2022] GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252 => generated 1521 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:54:51.554524 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4dabe35a-d1f0-42e6-9130-a24d864e8c89 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:51.561798 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4dabe35a-d1f0-42e6-9130-a24d864e8c89 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: f3ba81ef-4875-4ba4-94e0-c8275bfcf252] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:51.590969 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4dabe35a-d1f0-42e6-9130-a24d864e8c89 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:51.592377 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4dabe35a-d1f0-42e6-9130-a24d864e8c89 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:51.593544 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4dabe35a-d1f0-42e6-9130-a24d864e8c89 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:51.601105 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4dabe35a-d1f0-42e6-9130-a24d864e8c89 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:51.602405 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4dabe35a-d1f0-42e6-9130-a24d864e8c89 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:51.603512 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4dabe35a-d1f0-42e6-9130-a24d864e8c89 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:52.965095 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4dabe35a-d1f0-42e6-9130-a24d864e8c89 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:53.001327 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4dabe35a-d1f0-42e6-9130-a24d864e8c89 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252" status: 200 len: 1521 microversion: 2.1 time: 1.453909 Sep 12 23:54:53.011165 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 90/174] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:51 2022] GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252 => generated 1521 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:54:54.073663 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e84e1b88-21a6-4a39-9e56-26b24dc3d39a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:54.076042 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e84e1b88-21a6-4a39-9e56-26b24dc3d39a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: f3ba81ef-4875-4ba4-94e0-c8275bfcf252] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:54.083163 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:54:54.103565 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e84e1b88-21a6-4a39-9e56-26b24dc3d39a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:54.103565 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e84e1b88-21a6-4a39-9e56-26b24dc3d39a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:54.103565 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e84e1b88-21a6-4a39-9e56-26b24dc3d39a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:54.103565 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e84e1b88-21a6-4a39-9e56-26b24dc3d39a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:54.104106 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e84e1b88-21a6-4a39-9e56-26b24dc3d39a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:54.104106 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e84e1b88-21a6-4a39-9e56-26b24dc3d39a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:54.396171 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e84e1b88-21a6-4a39-9e56-26b24dc3d39a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:54.419191 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e84e1b88-21a6-4a39-9e56-26b24dc3d39a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252" status: 200 len: 1521 microversion: 2.1 time: 0.370624 Sep 12 23:54:54.433692 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 85/175] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:54 2022] GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252 => generated 1521 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:54:55.450748 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-49138b67-8be4-49b5-aeb9-c4a6e7e05a05 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:55.451515 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-49138b67-8be4-49b5-aeb9-c4a6e7e05a05 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: f3ba81ef-4875-4ba4-94e0-c8275bfcf252] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:55.464721 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-49138b67-8be4-49b5-aeb9-c4a6e7e05a05 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:55.467658 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-49138b67-8be4-49b5-aeb9-c4a6e7e05a05 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:55.470417 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-49138b67-8be4-49b5-aeb9-c4a6e7e05a05 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:55.471562 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-49138b67-8be4-49b5-aeb9-c4a6e7e05a05 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:55.478468 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-49138b67-8be4-49b5-aeb9-c4a6e7e05a05 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:55.481129 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-49138b67-8be4-49b5-aeb9-c4a6e7e05a05 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:56.112825 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-49138b67-8be4-49b5-aeb9-c4a6e7e05a05 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:56.126161 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-49138b67-8be4-49b5-aeb9-c4a6e7e05a05 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252" status: 200 len: 1521 microversion: 2.1 time: 0.679733 Sep 12 23:54:56.140624 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 91/176] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:55 2022] GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252 => generated 1521 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:54:57.157794 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ef6d4d49-d505-4bdc-8684-a41584ce12a4 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:57.172537 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ef6d4d49-d505-4bdc-8684-a41584ce12a4 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: f3ba81ef-4875-4ba4-94e0-c8275bfcf252] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:57.196768 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ef6d4d49-d505-4bdc-8684-a41584ce12a4 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:57.197350 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ef6d4d49-d505-4bdc-8684-a41584ce12a4 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:57.205444 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ef6d4d49-d505-4bdc-8684-a41584ce12a4 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:57.206357 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ef6d4d49-d505-4bdc-8684-a41584ce12a4 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:57.207020 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ef6d4d49-d505-4bdc-8684-a41584ce12a4 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:57.207352 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ef6d4d49-d505-4bdc-8684-a41584ce12a4 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:57.679833 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ef6d4d49-d505-4bdc-8684-a41584ce12a4 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:57.708433 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ef6d4d49-d505-4bdc-8684-a41584ce12a4 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252" status: 200 len: 1501 microversion: 2.1 time: 0.554533 Sep 12 23:54:57.709368 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 86/177] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:57 2022] GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252 => generated 1501 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:54:57.754693 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8866a1aa-d2d4-46da-aeb2-522d9cb43753 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:54:57.756857 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8866a1aa-d2d4-46da-aeb2-522d9cb43753 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 695586a7-2b4d-477b-ab83-9e74f5f7078a] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:54:57.786789 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8866a1aa-d2d4-46da-aeb2-522d9cb43753 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:57.787749 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8866a1aa-d2d4-46da-aeb2-522d9cb43753 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:57.790173 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8866a1aa-d2d4-46da-aeb2-522d9cb43753 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:57.799634 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8866a1aa-d2d4-46da-aeb2-522d9cb43753 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:54:57.808062 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8866a1aa-d2d4-46da-aeb2-522d9cb43753 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:54:57.809179 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8866a1aa-d2d4-46da-aeb2-522d9cb43753 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:54:58.372309 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8866a1aa-d2d4-46da-aeb2-522d9cb43753 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:54:58.396665 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8866a1aa-d2d4-46da-aeb2-522d9cb43753 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a" status: 200 len: 1517 microversion: 2.1 time: 0.648589 Sep 12 23:54:58.413920 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 92/178] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:54:57 2022] GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a => generated 1517 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:00.749509 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d988e762-c8b6-49af-8a96-ad9be3420752 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:55:00.756970 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d988e762-c8b6-49af-8a96-ad9be3420752 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 695586a7-2b4d-477b-ab83-9e74f5f7078a] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:00.766551 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d988e762-c8b6-49af-8a96-ad9be3420752 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:00.767849 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d988e762-c8b6-49af-8a96-ad9be3420752 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:00.768608 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d988e762-c8b6-49af-8a96-ad9be3420752 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:00.769960 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d988e762-c8b6-49af-8a96-ad9be3420752 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:00.770825 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d988e762-c8b6-49af-8a96-ad9be3420752 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:00.773133 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d988e762-c8b6-49af-8a96-ad9be3420752 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:00.812362 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.objects.instance [None req-d988e762-c8b6-49af-8a96-ad9be3420752 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lazy-loading 'flavor' on Instance uuid 695586a7-2b4d-477b-ab83-9e74f5f7078a {{(pid=126976) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 23:55:01.184695 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d988e762-c8b6-49af-8a96-ad9be3420752 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "POST /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a/action" status: 200 len: 32 microversion: 2.1 time: 0.440323 Sep 12 23:55:01.196887 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b26e8192-4d01-4b24-8233-de38f91578d3 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:01.198113 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b26e8192-4d01-4b24-8233-de38f91578d3 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 695586a7-2b4d-477b-ab83-9e74f5f7078a] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:01.205205 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 87/179] 10.222.0.26 () {60 vars in 1278 bytes} [Mon Sep 12 23:55:00 2022] POST /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a/action => generated 32 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 12 23:55:01.221998 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b26e8192-4d01-4b24-8233-de38f91578d3 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:01.222507 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b26e8192-4d01-4b24-8233-de38f91578d3 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:01.222971 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b26e8192-4d01-4b24-8233-de38f91578d3 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:01.241833 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b26e8192-4d01-4b24-8233-de38f91578d3 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:01.243441 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b26e8192-4d01-4b24-8233-de38f91578d3 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:01.245765 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b26e8192-4d01-4b24-8233-de38f91578d3 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:01.881998 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b26e8192-4d01-4b24-8233-de38f91578d3 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:01.890047 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=70 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:55:01.901674 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b26e8192-4d01-4b24-8233-de38f91578d3 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a" status: 200 len: 1523 microversion: 2.1 time: 0.709150 Sep 12 23:55:01.906430 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 93/180] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:01 2022] GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a => generated 1523 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:55:02.948825 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-140727b2-8104-4f8b-8871-6e76b817c891 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:02.955011 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-140727b2-8104-4f8b-8871-6e76b817c891 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 695586a7-2b4d-477b-ab83-9e74f5f7078a] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:02.996454 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-140727b2-8104-4f8b-8871-6e76b817c891 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:02.997690 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-140727b2-8104-4f8b-8871-6e76b817c891 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:02.998695 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-140727b2-8104-4f8b-8871-6e76b817c891 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:03.000412 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-140727b2-8104-4f8b-8871-6e76b817c891 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:03.001689 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-140727b2-8104-4f8b-8871-6e76b817c891 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:03.003700 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-140727b2-8104-4f8b-8871-6e76b817c891 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:04.346951 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-140727b2-8104-4f8b-8871-6e76b817c891 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:04.407387 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-140727b2-8104-4f8b-8871-6e76b817c891 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a" status: 200 len: 1523 microversion: 2.1 time: 1.472604 Sep 12 23:55:04.408415 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 88/181] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:02 2022] GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a => generated 1523 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:05.464560 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-60310a8d-2bda-4339-b40d-26f822612e77 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:05.465880 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-60310a8d-2bda-4339-b40d-26f822612e77 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 695586a7-2b4d-477b-ab83-9e74f5f7078a] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:05.485797 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-60310a8d-2bda-4339-b40d-26f822612e77 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:05.490932 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-60310a8d-2bda-4339-b40d-26f822612e77 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:05.493819 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-60310a8d-2bda-4339-b40d-26f822612e77 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:05.495086 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-60310a8d-2bda-4339-b40d-26f822612e77 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:05.504495 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-60310a8d-2bda-4339-b40d-26f822612e77 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:05.505133 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-60310a8d-2bda-4339-b40d-26f822612e77 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:05.809864 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-60310a8d-2bda-4339-b40d-26f822612e77 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:05.820915 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-60310a8d-2bda-4339-b40d-26f822612e77 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a" status: 200 len: 1523 microversion: 2.1 time: 0.362494 Sep 12 23:55:05.836942 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 94/182] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:05 2022] GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a => generated 1523 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:06.848681 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0a3b96d3-00dd-4b76-a627-4d9a0fc22406 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:06.849505 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0a3b96d3-00dd-4b76-a627-4d9a0fc22406 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 695586a7-2b4d-477b-ab83-9e74f5f7078a] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:06.865754 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0a3b96d3-00dd-4b76-a627-4d9a0fc22406 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:06.866236 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0a3b96d3-00dd-4b76-a627-4d9a0fc22406 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:06.876355 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0a3b96d3-00dd-4b76-a627-4d9a0fc22406 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:06.877676 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0a3b96d3-00dd-4b76-a627-4d9a0fc22406 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:06.878880 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0a3b96d3-00dd-4b76-a627-4d9a0fc22406 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:06.881082 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0a3b96d3-00dd-4b76-a627-4d9a0fc22406 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:06.889653 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:55:07.386418 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0a3b96d3-00dd-4b76-a627-4d9a0fc22406 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:07.494725 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0a3b96d3-00dd-4b76-a627-4d9a0fc22406 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a" status: 200 len: 1523 microversion: 2.1 time: 0.649634 Sep 12 23:55:07.501508 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 89/183] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:06 2022] GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a => generated 1523 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:55:08.524709 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-61e27881-6832-4887-b697-72cbc62591c7 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:08.525578 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-61e27881-6832-4887-b697-72cbc62591c7 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 695586a7-2b4d-477b-ab83-9e74f5f7078a] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:08.567809 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-61e27881-6832-4887-b697-72cbc62591c7 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:08.568841 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-61e27881-6832-4887-b697-72cbc62591c7 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:08.569593 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-61e27881-6832-4887-b697-72cbc62591c7 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:08.577046 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-61e27881-6832-4887-b697-72cbc62591c7 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:08.581424 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-61e27881-6832-4887-b697-72cbc62591c7 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:08.584638 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-61e27881-6832-4887-b697-72cbc62591c7 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:09.149710 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-61e27881-6832-4887-b697-72cbc62591c7 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:09.167352 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-61e27881-6832-4887-b697-72cbc62591c7 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a" status: 200 len: 1523 microversion: 2.1 time: 0.646213 Sep 12 23:55:09.172186 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 95/184] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:08 2022] GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a => generated 1523 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:09.275961 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f59a674d-7bef-4edb-b166-d1c785db5b4b tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Action: 'create', calling method: .version_select at 0x7fed019ac160>, body: {"keypair": {"name": "tempest-keypair-46171062", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZcE3KQLKOsLBkJ7v00I5JdNetpXUrr4glFFlEo6U1DTC6TXEyCs7RrZlFWYiAqn04ipCImnpp7XEhBYzXKpyMjYHtw6/23K22KtfMpw+cOTZeCHQK3kK0VmNGM5UXYdA=="}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:55:09.339203 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-f59a674d-7bef-4edb-b166-d1c785db5b4b tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Getting quotas for project ffc5ce52ae574b82bda143e766bcec80. Resources: {'key_pairs'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 23:55:09.351517 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-f59a674d-7bef-4edb-b166-d1c785db5b4b tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Getting quotas for user 0d81b048f7e64c53894ad9e9ee33f518 and project ffc5ce52ae574b82bda143e766bcec80. Resources: {'key_pairs'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 23:55:09.462570 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f59a674d-7bef-4edb-b166-d1c785db5b4b tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.573417 Sep 12 23:55:09.464083 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 90/185] 10.222.0.26 () {60 vars in 1159 bytes} [Mon Sep 12 23:55:08 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:55:10.196829 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-74fb619a-cb6f-47fc-8e43-21d18588c2e0 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:10.197764 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-74fb619a-cb6f-47fc-8e43-21d18588c2e0 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 695586a7-2b4d-477b-ab83-9e74f5f7078a] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:10.218216 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-74fb619a-cb6f-47fc-8e43-21d18588c2e0 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:10.219047 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-74fb619a-cb6f-47fc-8e43-21d18588c2e0 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:10.220014 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-74fb619a-cb6f-47fc-8e43-21d18588c2e0 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:10.221130 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-74fb619a-cb6f-47fc-8e43-21d18588c2e0 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:10.221947 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-74fb619a-cb6f-47fc-8e43-21d18588c2e0 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:10.222748 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-74fb619a-cb6f-47fc-8e43-21d18588c2e0 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:10.979012 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-74fb619a-cb6f-47fc-8e43-21d18588c2e0 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:11.015287 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-74fb619a-cb6f-47fc-8e43-21d18588c2e0 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a" status: 200 len: 1523 microversion: 2.1 time: 0.823658 Sep 12 23:55:11.043929 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 96/186] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:10 2022] GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a => generated 1523 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:11.545728 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1846b815-96cc-4f9b-999e-61d2919dffb4 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:11.546747 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1846b815-96cc-4f9b-999e-61d2919dffb4 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: 1bdd77eb-4b69-4630-9f49-a1d317bb1e12] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:11.561091 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1846b815-96cc-4f9b-999e-61d2919dffb4 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:11.561601 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1846b815-96cc-4f9b-999e-61d2919dffb4 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:11.573884 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1846b815-96cc-4f9b-999e-61d2919dffb4 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:11.575154 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1846b815-96cc-4f9b-999e-61d2919dffb4 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:11.585164 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1846b815-96cc-4f9b-999e-61d2919dffb4 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:11.590263 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1846b815-96cc-4f9b-999e-61d2919dffb4 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:11.757954 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1846b815-96cc-4f9b-999e-61d2919dffb4 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12/ips" status: 200 len: 150 microversion: 2.1 time: 0.215559 Sep 12 23:55:11.782453 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 91/187] 10.222.0.26 () {58 vars in 1248 bytes} [Mon Sep 12 23:55:11 2022] GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12/ips => generated 150 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:55:12.091480 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-278d3ee7-c8af-4268-82fd-8b8340e284f6 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:12.093677 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-278d3ee7-c8af-4268-82fd-8b8340e284f6 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 695586a7-2b4d-477b-ab83-9e74f5f7078a] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:12.118368 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-278d3ee7-c8af-4268-82fd-8b8340e284f6 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:12.119741 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-278d3ee7-c8af-4268-82fd-8b8340e284f6 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:12.120825 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-278d3ee7-c8af-4268-82fd-8b8340e284f6 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:12.123410 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-278d3ee7-c8af-4268-82fd-8b8340e284f6 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:12.124666 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-278d3ee7-c8af-4268-82fd-8b8340e284f6 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:12.125697 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-278d3ee7-c8af-4268-82fd-8b8340e284f6 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:12.776541 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-33de34ff-96a7-4fb4-9ab3-1e9a66ccca92 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:12.778382 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-33de34ff-96a7-4fb4-9ab3-1e9a66ccca92 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:12.784061 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-278d3ee7-c8af-4268-82fd-8b8340e284f6 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:12.800565 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-33de34ff-96a7-4fb4-9ab3-1e9a66ccca92 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:12.802380 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-33de34ff-96a7-4fb4-9ab3-1e9a66ccca92 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:12.805603 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-33de34ff-96a7-4fb4-9ab3-1e9a66ccca92 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:12.807951 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-33de34ff-96a7-4fb4-9ab3-1e9a66ccca92 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:12.810452 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-278d3ee7-c8af-4268-82fd-8b8340e284f6 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a" status: 200 len: 1523 microversion: 2.1 time: 0.761097 Sep 12 23:55:12.811298 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-33de34ff-96a7-4fb4-9ab3-1e9a66ccca92 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:12.814472 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-33de34ff-96a7-4fb4-9ab3-1e9a66ccca92 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:12.816052 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 97/188] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:12 2022] GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a => generated 1523 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:12.920179 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-33de34ff-96a7-4fb4-9ab3-1e9a66ccca92 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65/ips" status: 200 len: 152 microversion: 2.20 time: 0.146575 Sep 12 23:55:12.922939 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 92/189] 10.222.0.26 () {60 vars in 1289 bytes} [Mon Sep 12 23:55:12 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65/ips => generated 152 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 12 23:55:13.862111 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-00e11aba-456d-46a0-8e65-bbe8f4148fa1 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:13.863837 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-00e11aba-456d-46a0-8e65-bbe8f4148fa1 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 695586a7-2b4d-477b-ab83-9e74f5f7078a] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:13.948167 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-00e11aba-456d-46a0-8e65-bbe8f4148fa1 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:13.949099 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-00e11aba-456d-46a0-8e65-bbe8f4148fa1 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:13.955613 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-00e11aba-456d-46a0-8e65-bbe8f4148fa1 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:13.967497 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-00e11aba-456d-46a0-8e65-bbe8f4148fa1 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:13.968435 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-00e11aba-456d-46a0-8e65-bbe8f4148fa1 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:13.969238 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-00e11aba-456d-46a0-8e65-bbe8f4148fa1 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:14.381269 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6b841460-2a75-4f0a-8750-438261327ae9 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "059d0261-28d7-4667-809e-0808cdc7047d"}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:55:14.400958 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6b841460-2a75-4f0a-8750-438261327ae9 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: 1bdd77eb-4b69-4630-9f49-a1d317bb1e12] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:14.434897 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6b841460-2a75-4f0a-8750-438261327ae9 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:14.436318 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6b841460-2a75-4f0a-8750-438261327ae9 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:14.440328 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6b841460-2a75-4f0a-8750-438261327ae9 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:14.444416 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6b841460-2a75-4f0a-8750-438261327ae9 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:14.456002 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6b841460-2a75-4f0a-8750-438261327ae9 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:14.459306 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6b841460-2a75-4f0a-8750-438261327ae9 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:14.779727 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-00e11aba-456d-46a0-8e65-bbe8f4148fa1 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:14.812400 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-00e11aba-456d-46a0-8e65-bbe8f4148fa1 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a" status: 200 len: 1523 microversion: 2.1 time: 0.954488 Sep 12 23:55:14.821782 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 98/190] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:13 2022] GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a => generated 1523 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:14.849067 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c1461845-0370-457c-a4cf-cb4169f8af31 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-124200473", "imageRef": "22a47167-5e04-441a-a504-d76d82afc776", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "923e930b-b793-481f-a057-be9c6d7f3f9d"}], "security_groups": [{"name": "tempest-securitygroup--1039249302"}], "key_name": "tempest-keypair-46171062", "user_data": "}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:55:15.281686 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.network.neutron [None req-c1461845-0370-457c-a4cf-cb4169f8af31 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] validate_networks() for [('923e930b-b793-481f-a057-be9c6d7f3f9d', None, None, None, None, None)] {{(pid=126975) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 23:55:15.565489 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6b841460-2a75-4f0a-8750-438261327ae9 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "POST /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.147884 Sep 12 23:55:15.567596 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 93/191] 10.222.0.26 () {60 vars in 1323 bytes} [Mon Sep 12 23:55:14 2022] POST /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12/os-volume_attachments => generated 194 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:55:15.873490 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6105b86f-6f8e-4b60-a522-1ba84d8ee92c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:15.874509 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6105b86f-6f8e-4b60-a522-1ba84d8ee92c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 695586a7-2b4d-477b-ab83-9e74f5f7078a] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:15.892845 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6105b86f-6f8e-4b60-a522-1ba84d8ee92c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:15.893401 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6105b86f-6f8e-4b60-a522-1ba84d8ee92c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:15.893848 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6105b86f-6f8e-4b60-a522-1ba84d8ee92c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:15.903935 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6105b86f-6f8e-4b60-a522-1ba84d8ee92c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:15.904478 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6105b86f-6f8e-4b60-a522-1ba84d8ee92c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:15.905923 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6105b86f-6f8e-4b60-a522-1ba84d8ee92c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:16.648512 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6105b86f-6f8e-4b60-a522-1ba84d8ee92c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:16.665210 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6105b86f-6f8e-4b60-a522-1ba84d8ee92c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a" status: 200 len: 1523 microversion: 2.1 time: 0.801646 Sep 12 23:55:16.666369 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 94/192] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:15 2022] GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a => generated 1523 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:16.675963 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-06e4cee6-aeaa-435a-8557-587a120f24d5 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Action: 'create', calling method: .version_select at 0x7fed01884790>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1956934466", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+0Rw5qNvVSta2WryF+2u3yZ/1466hlUyzKSp/CyZqnckqCow06zI9AziRYjh282E8/1VeYTA7ImIleSjciJFd0+40wW6z6K/OF2QpEMPjaEO7niQSVRZUisNiKO/8lZA=="}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:55:16.706734 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-06e4cee6-aeaa-435a-8557-587a120f24d5 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Getting quotas for project 880f7d1c88224ebd85d15f7c43e7fe72. Resources: {'key_pairs'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 23:55:16.714857 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-06e4cee6-aeaa-435a-8557-587a120f24d5 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Getting quotas for user e76b3353ce4b4361872ed6dba9f895d6 and project 880f7d1c88224ebd85d15f7c43e7fe72. Resources: {'key_pairs'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 23:55:16.788981 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-06e4cee6-aeaa-435a-8557-587a120f24d5 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.120008 Sep 12 23:55:16.790856 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 95/193] 10.222.0.26 () {60 vars in 1159 bytes} [Mon Sep 12 23:55:16 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:55:16.800260 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-119b40da-de0e-402a-8cd8-02e0048284ff tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:55:16.810677 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-119b40da-de0e-402a-8cd8-02e0048284ff tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:16.833720 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-119b40da-de0e-402a-8cd8-02e0048284ff tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:16.834469 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-119b40da-de0e-402a-8cd8-02e0048284ff tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:16.835068 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-119b40da-de0e-402a-8cd8-02e0048284ff tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:16.836051 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-119b40da-de0e-402a-8cd8-02e0048284ff tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:16.836728 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-119b40da-de0e-402a-8cd8-02e0048284ff tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:16.837312 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-119b40da-de0e-402a-8cd8-02e0048284ff tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:16.871549 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.objects.instance [None req-119b40da-de0e-402a-8cd8-02e0048284ff tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lazy-loading 'flavor' on Instance uuid 893ed869-802c-4a92-b7ab-d2aa8324fb65 {{(pid=126976) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 23:55:16.926789 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-c1461845-0370-457c-a4cf-cb4169f8af31 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Flavor limits 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 23:55:16.928073 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-c1461845-0370-457c-a4cf-cb4169f8af31 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Image limits 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 23:55:16.928884 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-c1461845-0370-457c-a4cf-cb4169f8af31 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Flavor pref 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 23:55:16.929460 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-c1461845-0370-457c-a4cf-cb4169f8af31 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Image pref 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 23:55:16.930028 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-c1461845-0370-457c-a4cf-cb4169f8af31 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 23:55:16.941940 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c1461845-0370-457c-a4cf-cb4169f8af31 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:16.942728 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c1461845-0370-457c-a4cf-cb4169f8af31 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:16.943343 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c1461845-0370-457c-a4cf-cb4169f8af31 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:16.944722 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c1461845-0370-457c-a4cf-cb4169f8af31 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:16.945537 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c1461845-0370-457c-a4cf-cb4169f8af31 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:16.946130 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c1461845-0370-457c-a4cf-cb4169f8af31 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:16.971109 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-c1461845-0370-457c-a4cf-cb4169f8af31 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Getting quotas for project ffc5ce52ae574b82bda143e766bcec80. Resources: {'instances', 'cores', 'ram'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 23:55:16.976359 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-c1461845-0370-457c-a4cf-cb4169f8af31 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Getting quotas for user 0d81b048f7e64c53894ad9e9ee33f518 and project ffc5ce52ae574b82bda143e766bcec80. Resources: {'instances', 'cores', 'ram'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 23:55:16.999568 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c1461845-0370-457c-a4cf-cb4169f8af31 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Going to run 1 instances... {{(pid=126975) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 23:55:17.002368 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c1461845-0370-457c-a4cf-cb4169f8af31 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='22a47167-5e04-441a-a504-d76d82afc776',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126975) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 23:55:17.117506 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c1461845-0370-457c-a4cf-cb4169f8af31 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.291371 Sep 12 23:55:17.119076 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 99/194] 10.222.0.26 () {60 vars in 1147 bytes} [Mon Sep 12 23:55:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 2294 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 12 23:55:17.165247 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-010839c4-ffad-4e7b-b49c-a9306f2c44ca tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:17.167781 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-010839c4-ffad-4e7b-b49c-a9306f2c44ca tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:17.335749 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-010839c4-ffad-4e7b-b49c-a9306f2c44ca tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:17.343481 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-119b40da-de0e-402a-8cd8-02e0048284ff tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "POST /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65/action" status: 202 len: 0 microversion: 2.20 time: 0.550291 Sep 12 23:55:17.344257 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 96/195] 10.222.0.26 () {62 vars in 1319 bytes} [Mon Sep 12 23:55:16 2022] POST /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65/action => generated 0 bytes in 552 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 12 23:55:17.345843 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-010839c4-ffad-4e7b-b49c-a9306f2c44ca tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c" status: 200 len: 1235 microversion: 2.1 time: 0.210499 Sep 12 23:55:17.346728 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 100/196] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:17 2022] GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c => generated 1235 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:17.367736 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-fee5416d-d0af-47b1-8074-fe5862d1d9b3 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1556710431", "imageRef": "3640c1da-df6d-4d90-8711-a8ff9ab1581b", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1956934466", "networks": [{"uuid": "21bf63a0-2c64-49f9-bfe5-14fd7ac5e729"}]}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:55:17.377877 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-13e8ac46-ffc4-4f31-a78b-f2fc547ffb94 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:17.388290 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-13e8ac46-ffc4-4f31-a78b-f2fc547ffb94 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:17.464130 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-13e8ac46-ffc4-4f31-a78b-f2fc547ffb94 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:17.468720 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-13e8ac46-ffc4-4f31-a78b-f2fc547ffb94 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:17.469329 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-13e8ac46-ffc4-4f31-a78b-f2fc547ffb94 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:17.470703 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-13e8ac46-ffc4-4f31-a78b-f2fc547ffb94 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:17.471562 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-13e8ac46-ffc4-4f31-a78b-f2fc547ffb94 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:17.472256 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-13e8ac46-ffc4-4f31-a78b-f2fc547ffb94 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:17.505190 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.network.neutron [None req-fee5416d-d0af-47b1-8074-fe5862d1d9b3 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] validate_networks() for [('21bf63a0-2c64-49f9-bfe5-14fd7ac5e729', None, None, None, None, None)] {{(pid=126976) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 23:55:17.897424 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-13e8ac46-ffc4-4f31-a78b-f2fc547ffb94 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:17.911726 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-13e8ac46-ffc4-4f31-a78b-f2fc547ffb94 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:17.914934 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-13e8ac46-ffc4-4f31-a78b-f2fc547ffb94 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:17.918108 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-13e8ac46-ffc4-4f31-a78b-f2fc547ffb94 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1725 microversion: 2.20 time: 0.563109 Sep 12 23:55:17.935249 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 101/197] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:55:17 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1725 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:55:17.950065 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-706d5016-a2ad-4205-8c5c-46804be62d1f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:17.952299 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-706d5016-a2ad-4205-8c5c-46804be62d1f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 695586a7-2b4d-477b-ab83-9e74f5f7078a] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:17.964852 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-706d5016-a2ad-4205-8c5c-46804be62d1f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:17.965409 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-706d5016-a2ad-4205-8c5c-46804be62d1f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:17.965909 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-706d5016-a2ad-4205-8c5c-46804be62d1f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:17.971746 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-706d5016-a2ad-4205-8c5c-46804be62d1f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:17.972229 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-706d5016-a2ad-4205-8c5c-46804be62d1f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:17.972662 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-706d5016-a2ad-4205-8c5c-46804be62d1f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:18.308442 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-706d5016-a2ad-4205-8c5c-46804be62d1f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:18.321031 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-706d5016-a2ad-4205-8c5c-46804be62d1f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a" status: 200 len: 1523 microversion: 2.1 time: 0.385930 Sep 12 23:55:18.334607 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 102/198] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:17 2022] GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a => generated 1523 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:18.357204 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-fee5416d-d0af-47b1-8074-fe5862d1d9b3 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Flavor limits 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 23:55:18.357782 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-fee5416d-d0af-47b1-8074-fe5862d1d9b3 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Image limits 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 23:55:18.358114 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-fee5416d-d0af-47b1-8074-fe5862d1d9b3 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Flavor pref 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 23:55:18.358521 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-fee5416d-d0af-47b1-8074-fe5862d1d9b3 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Image pref 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 23:55:18.358932 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-fee5416d-d0af-47b1-8074-fe5862d1d9b3 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 23:55:18.369913 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fee5416d-d0af-47b1-8074-fe5862d1d9b3 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:18.370477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fee5416d-d0af-47b1-8074-fe5862d1d9b3 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:18.370945 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fee5416d-d0af-47b1-8074-fe5862d1d9b3 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:18.371838 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fee5416d-d0af-47b1-8074-fe5862d1d9b3 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:18.372317 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fee5416d-d0af-47b1-8074-fe5862d1d9b3 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:18.372890 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fee5416d-d0af-47b1-8074-fe5862d1d9b3 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:18.386470 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-09d9f5c8-f86d-4b6b-b4c4-ae0cd2e2c102 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:18.387194 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-09d9f5c8-f86d-4b6b-b4c4-ae0cd2e2c102 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:18.394387 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-09d9f5c8-f86d-4b6b-b4c4-ae0cd2e2c102 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:18.394984 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-09d9f5c8-f86d-4b6b-b4c4-ae0cd2e2c102 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:18.395537 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-09d9f5c8-f86d-4b6b-b4c4-ae0cd2e2c102 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:18.396311 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-09d9f5c8-f86d-4b6b-b4c4-ae0cd2e2c102 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:18.396771 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-09d9f5c8-f86d-4b6b-b4c4-ae0cd2e2c102 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:18.397216 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-09d9f5c8-f86d-4b6b-b4c4-ae0cd2e2c102 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:18.407334 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-fee5416d-d0af-47b1-8074-fe5862d1d9b3 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Getting quotas for project 880f7d1c88224ebd85d15f7c43e7fe72. Resources: {'instances', 'cores', 'ram'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 23:55:18.413696 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-fee5416d-d0af-47b1-8074-fe5862d1d9b3 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Getting quotas for user e76b3353ce4b4361872ed6dba9f895d6 and project 880f7d1c88224ebd85d15f7c43e7fe72. Resources: {'instances', 'cores', 'ram'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 23:55:18.428463 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-fee5416d-d0af-47b1-8074-fe5862d1d9b3 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Going to run 1 instances... {{(pid=126976) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 23:55:18.431963 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-fee5416d-d0af-47b1-8074-fe5862d1d9b3 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] [instance: c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3640c1da-df6d-4d90-8711-a8ff9ab1581b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126976) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 23:55:18.478182 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-09d9f5c8-f86d-4b6b-b4c4-ae0cd2e2c102 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:18.487459 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-09d9f5c8-f86d-4b6b-b4c4-ae0cd2e2c102 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c" status: 200 len: 1239 microversion: 2.1 time: 0.104749 Sep 12 23:55:18.500215 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 103/199] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:18 2022] GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c => generated 1239 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:55:18.500416 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-fee5416d-d0af-47b1-8074-fe5862d1d9b3 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.153981 Sep 12 23:55:18.500416 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 97/200] 10.222.0.26 () {60 vars in 1147 bytes} [Mon Sep 12 23:55:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1155 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 12 23:55:18.513373 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8bc28dfe-f36a-4675-a5a7-6d6588769fae tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:18.513615 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8bc28dfe-f36a-4675-a5a7-6d6588769fae tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] [instance: c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:18.608067 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8bc28dfe-f36a-4675-a5a7-6d6588769fae tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76b3353ce4b4361872ed6dba9f895d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f7d1c88224ebd85d15f7c43e7fe72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:18.621982 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8bc28dfe-f36a-4675-a5a7-6d6588769fae tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a" status: 200 len: 1259 microversion: 2.1 time: 0.114021 Sep 12 23:55:18.623935 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 104/201] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:18 2022] GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a => generated 1259 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:55:18.960302 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-531d3444-5fae-4ea8-bde6-02862b078073 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:18.965391 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-531d3444-5fae-4ea8-bde6-02862b078073 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:18.990964 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-531d3444-5fae-4ea8-bde6-02862b078073 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:18.991942 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-531d3444-5fae-4ea8-bde6-02862b078073 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:18.993208 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-531d3444-5fae-4ea8-bde6-02862b078073 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:18.995016 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-531d3444-5fae-4ea8-bde6-02862b078073 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:18.996345 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-531d3444-5fae-4ea8-bde6-02862b078073 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:18.997379 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-531d3444-5fae-4ea8-bde6-02862b078073 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:19.304824 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-531d3444-5fae-4ea8-bde6-02862b078073 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:19.316883 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-531d3444-5fae-4ea8-bde6-02862b078073 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:19.318703 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-531d3444-5fae-4ea8-bde6-02862b078073 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:19.320260 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-531d3444-5fae-4ea8-bde6-02862b078073 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1725 microversion: 2.20 time: 0.372168 Sep 12 23:55:19.335659 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 98/202] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:55:18 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1725 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:55:19.361146 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-075d8e37-84f6-40bb-8356-bfce95442893 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:19.363149 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-075d8e37-84f6-40bb-8356-bfce95442893 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 695586a7-2b4d-477b-ab83-9e74f5f7078a] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:19.366044 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:55:19.375420 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-075d8e37-84f6-40bb-8356-bfce95442893 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:19.376274 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-075d8e37-84f6-40bb-8356-bfce95442893 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:19.376724 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-075d8e37-84f6-40bb-8356-bfce95442893 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:19.377689 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-075d8e37-84f6-40bb-8356-bfce95442893 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:19.378154 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-075d8e37-84f6-40bb-8356-bfce95442893 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:19.378572 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-075d8e37-84f6-40bb-8356-bfce95442893 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:19.526553 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-bd6a4b25-2551-4031-9ff2-2624e562f59c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:19.528241 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-bd6a4b25-2551-4031-9ff2-2624e562f59c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:19.542896 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd6a4b25-2551-4031-9ff2-2624e562f59c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:19.542896 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd6a4b25-2551-4031-9ff2-2624e562f59c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:19.543261 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-075d8e37-84f6-40bb-8356-bfce95442893 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:19.543456 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd6a4b25-2551-4031-9ff2-2624e562f59c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:19.543683 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd6a4b25-2551-4031-9ff2-2624e562f59c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:19.544673 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd6a4b25-2551-4031-9ff2-2624e562f59c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:19.544673 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd6a4b25-2551-4031-9ff2-2624e562f59c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:19.553351 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-075d8e37-84f6-40bb-8356-bfce95442893 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a" status: 200 len: 1523 microversion: 2.1 time: 0.204915 Sep 12 23:55:19.554330 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 105/203] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:19 2022] GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a => generated 1523 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:19.634855 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-bd6a4b25-2551-4031-9ff2-2624e562f59c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:19.647167 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-631e4c0f-416b-492f-9beb-e449dedc26fd tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:19.647929 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-631e4c0f-416b-492f-9beb-e449dedc26fd tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] [instance: c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:19.649322 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-bd6a4b25-2551-4031-9ff2-2624e562f59c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c" status: 200 len: 1287 microversion: 2.1 time: 0.130437 Sep 12 23:55:19.651010 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 99/204] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:19 2022] GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c => generated 1287 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:55:19.655856 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-631e4c0f-416b-492f-9beb-e449dedc26fd tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:19.656699 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-631e4c0f-416b-492f-9beb-e449dedc26fd tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:19.657397 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-631e4c0f-416b-492f-9beb-e449dedc26fd tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:19.658553 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-631e4c0f-416b-492f-9beb-e449dedc26fd tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:19.659077 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-631e4c0f-416b-492f-9beb-e449dedc26fd tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:19.659618 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-631e4c0f-416b-492f-9beb-e449dedc26fd tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:19.732712 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-631e4c0f-416b-492f-9beb-e449dedc26fd tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76b3353ce4b4361872ed6dba9f895d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f7d1c88224ebd85d15f7c43e7fe72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:19.741184 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-631e4c0f-416b-492f-9beb-e449dedc26fd tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a" status: 200 len: 1255 microversion: 2.1 time: 0.098130 Sep 12 23:55:19.741785 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 106/205] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:19 2022] GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a => generated 1255 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:55:20.355079 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-cf437241-a1a1-4012-8482-a49217515dae tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:20.356452 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-cf437241-a1a1-4012-8482-a49217515dae tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:20.376200 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cf437241-a1a1-4012-8482-a49217515dae tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:20.376889 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cf437241-a1a1-4012-8482-a49217515dae tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:20.377407 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cf437241-a1a1-4012-8482-a49217515dae tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:20.378807 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cf437241-a1a1-4012-8482-a49217515dae tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:20.379716 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cf437241-a1a1-4012-8482-a49217515dae tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:20.380334 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cf437241-a1a1-4012-8482-a49217515dae tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:20.575089 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-cf437241-a1a1-4012-8482-a49217515dae tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:20.580281 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-feb6d442-6884-459e-aea0-55eb0f41673c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:20.581282 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-feb6d442-6884-459e-aea0-55eb0f41673c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 695586a7-2b4d-477b-ab83-9e74f5f7078a] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:20.586500 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-cf437241-a1a1-4012-8482-a49217515dae tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:20.588215 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-cf437241-a1a1-4012-8482-a49217515dae tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:20.589932 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-cf437241-a1a1-4012-8482-a49217515dae tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1725 microversion: 2.20 time: 0.242641 Sep 12 23:55:20.590511 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 100/206] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:55:20 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1725 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:55:20.591127 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-feb6d442-6884-459e-aea0-55eb0f41673c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:20.591996 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-feb6d442-6884-459e-aea0-55eb0f41673c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:20.592745 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-feb6d442-6884-459e-aea0-55eb0f41673c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:20.594015 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-feb6d442-6884-459e-aea0-55eb0f41673c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:20.594834 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-feb6d442-6884-459e-aea0-55eb0f41673c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:20.595762 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-feb6d442-6884-459e-aea0-55eb0f41673c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:20.680780 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-620c0b55-38c4-47ee-bb9a-dd5f33552f5b tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:20.681935 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-620c0b55-38c4-47ee-bb9a-dd5f33552f5b tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:20.689240 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-620c0b55-38c4-47ee-bb9a-dd5f33552f5b tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:20.690079 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-620c0b55-38c4-47ee-bb9a-dd5f33552f5b tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:20.690763 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-620c0b55-38c4-47ee-bb9a-dd5f33552f5b tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:20.691638 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-620c0b55-38c4-47ee-bb9a-dd5f33552f5b tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:20.692118 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-620c0b55-38c4-47ee-bb9a-dd5f33552f5b tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:20.692675 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-620c0b55-38c4-47ee-bb9a-dd5f33552f5b tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:20.784264 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-620c0b55-38c4-47ee-bb9a-dd5f33552f5b tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:20.804937 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-620c0b55-38c4-47ee-bb9a-dd5f33552f5b tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c" status: 200 len: 1287 microversion: 2.1 time: 0.129302 Sep 12 23:55:20.806645 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 101/207] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:20 2022] GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c => generated 1287 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:55:20.816695 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7f6fe504-fac4-4d96-b82c-3f2f054cdba8 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:20.817958 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7f6fe504-fac4-4d96-b82c-3f2f054cdba8 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] [instance: c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:20.822411 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-feb6d442-6884-459e-aea0-55eb0f41673c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:20.830264 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7f6fe504-fac4-4d96-b82c-3f2f054cdba8 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:20.831124 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7f6fe504-fac4-4d96-b82c-3f2f054cdba8 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:20.832225 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7f6fe504-fac4-4d96-b82c-3f2f054cdba8 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:20.833921 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-feb6d442-6884-459e-aea0-55eb0f41673c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a" status: 200 len: 1523 microversion: 2.1 time: 0.259354 Sep 12 23:55:20.834067 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7f6fe504-fac4-4d96-b82c-3f2f054cdba8 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:20.834528 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 107/208] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:20 2022] GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a => generated 1523 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:55:20.835122 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7f6fe504-fac4-4d96-b82c-3f2f054cdba8 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:20.835975 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7f6fe504-fac4-4d96-b82c-3f2f054cdba8 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:20.965200 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7f6fe504-fac4-4d96-b82c-3f2f054cdba8 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76b3353ce4b4361872ed6dba9f895d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f7d1c88224ebd85d15f7c43e7fe72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:20.975932 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7f6fe504-fac4-4d96-b82c-3f2f054cdba8 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a" status: 200 len: 1255 microversion: 2.1 time: 0.167462 Sep 12 23:55:20.976968 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 102/209] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:20 2022] GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a => generated 1255 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:21.640156 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2456fe28-026b-4cf6-a3b6-f0739e28637e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:21.641393 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2456fe28-026b-4cf6-a3b6-f0739e28637e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:21.662867 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2456fe28-026b-4cf6-a3b6-f0739e28637e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:21.662867 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2456fe28-026b-4cf6-a3b6-f0739e28637e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:21.662867 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2456fe28-026b-4cf6-a3b6-f0739e28637e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:21.662867 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2456fe28-026b-4cf6-a3b6-f0739e28637e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:21.663207 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2456fe28-026b-4cf6-a3b6-f0739e28637e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:21.663207 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2456fe28-026b-4cf6-a3b6-f0739e28637e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:21.834022 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-32b3c2d4-7fa0-4aab-80ef-3f946bf96c84 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:21.834770 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-32b3c2d4-7fa0-4aab-80ef-3f946bf96c84 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:21.846987 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-32b3c2d4-7fa0-4aab-80ef-3f946bf96c84 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:21.848143 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-32b3c2d4-7fa0-4aab-80ef-3f946bf96c84 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:21.848143 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-32b3c2d4-7fa0-4aab-80ef-3f946bf96c84 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:21.849689 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-32b3c2d4-7fa0-4aab-80ef-3f946bf96c84 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:21.849689 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-32b3c2d4-7fa0-4aab-80ef-3f946bf96c84 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:21.849932 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-32b3c2d4-7fa0-4aab-80ef-3f946bf96c84 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:21.957146 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-32b3c2d4-7fa0-4aab-80ef-3f946bf96c84 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:21.974640 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-32b3c2d4-7fa0-4aab-80ef-3f946bf96c84 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c" status: 200 len: 1287 microversion: 2.1 time: 0.144540 Sep 12 23:55:21.976116 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 103/210] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:21 2022] GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c => generated 1287 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:55:21.986697 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7d909d0c-6411-41f5-a2d5-5f8628128f45 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:21.987869 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7d909d0c-6411-41f5-a2d5-5f8628128f45 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 695586a7-2b4d-477b-ab83-9e74f5f7078a] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:22.000971 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7d909d0c-6411-41f5-a2d5-5f8628128f45 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:22.001911 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7d909d0c-6411-41f5-a2d5-5f8628128f45 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:22.002691 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7d909d0c-6411-41f5-a2d5-5f8628128f45 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:22.003979 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7d909d0c-6411-41f5-a2d5-5f8628128f45 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:22.004799 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7d909d0c-6411-41f5-a2d5-5f8628128f45 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:22.005792 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7d909d0c-6411-41f5-a2d5-5f8628128f45 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:22.102294 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2456fe28-026b-4cf6-a3b6-f0739e28637e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:22.118649 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2456fe28-026b-4cf6-a3b6-f0739e28637e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:22.120256 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2456fe28-026b-4cf6-a3b6-f0739e28637e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:22.121802 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2456fe28-026b-4cf6-a3b6-f0739e28637e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1725 microversion: 2.20 time: 0.492454 Sep 12 23:55:22.136407 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 108/211] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:55:21 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1725 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:55:22.142081 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3b5c221d-455e-49ae-89d3-820adcf6b90d tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:22.142848 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3b5c221d-455e-49ae-89d3-820adcf6b90d tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] [instance: c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:22.155326 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3b5c221d-455e-49ae-89d3-820adcf6b90d tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:22.156247 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3b5c221d-455e-49ae-89d3-820adcf6b90d tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:22.156762 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3b5c221d-455e-49ae-89d3-820adcf6b90d tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:22.157527 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3b5c221d-455e-49ae-89d3-820adcf6b90d tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:22.158070 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3b5c221d-455e-49ae-89d3-820adcf6b90d tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:22.158499 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3b5c221d-455e-49ae-89d3-820adcf6b90d tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:22.265948 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3b5c221d-455e-49ae-89d3-820adcf6b90d tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76b3353ce4b4361872ed6dba9f895d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f7d1c88224ebd85d15f7c43e7fe72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:22.279991 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3b5c221d-455e-49ae-89d3-820adcf6b90d tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a" status: 200 len: 1255 microversion: 2.1 time: 0.142220 Sep 12 23:55:22.281125 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 109/212] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:22 2022] GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a => generated 1255 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:22.284997 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7d909d0c-6411-41f5-a2d5-5f8628128f45 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:22.294611 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7d909d0c-6411-41f5-a2d5-5f8628128f45 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a" status: 200 len: 1523 microversion: 2.1 time: 0.316886 Sep 12 23:55:22.295271 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 104/213] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:21 2022] GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a => generated 1523 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:23.003082 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f4fd339f-b711-456e-9e19-33a864a1b018 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:23.004008 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f4fd339f-b711-456e-9e19-33a864a1b018 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:23.010940 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4fd339f-b711-456e-9e19-33a864a1b018 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:23.011833 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4fd339f-b711-456e-9e19-33a864a1b018 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:23.012481 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4fd339f-b711-456e-9e19-33a864a1b018 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:23.013177 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4fd339f-b711-456e-9e19-33a864a1b018 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:23.013704 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4fd339f-b711-456e-9e19-33a864a1b018 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:23.014179 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4fd339f-b711-456e-9e19-33a864a1b018 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:23.098846 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f4fd339f-b711-456e-9e19-33a864a1b018 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:23.109055 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f4fd339f-b711-456e-9e19-33a864a1b018 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c" status: 200 len: 1295 microversion: 2.1 time: 0.110976 Sep 12 23:55:23.109670 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 110/214] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:22 2022] GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c => generated 1295 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:55:23.157603 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-27588239-18c1-4390-87e1-a429af615c7e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:23.158778 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-27588239-18c1-4390-87e1-a429af615c7e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:23.167053 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-27588239-18c1-4390-87e1-a429af615c7e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:23.167558 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-27588239-18c1-4390-87e1-a429af615c7e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:23.168068 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-27588239-18c1-4390-87e1-a429af615c7e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:23.168791 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-27588239-18c1-4390-87e1-a429af615c7e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:23.169266 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-27588239-18c1-4390-87e1-a429af615c7e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:23.169696 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-27588239-18c1-4390-87e1-a429af615c7e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:23.322373 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-6b34ad38-50ba-4581-bac6-6f5894e7052c tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:23.323826 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-6b34ad38-50ba-4581-bac6-6f5894e7052c tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] [instance: c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:23.336472 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6b34ad38-50ba-4581-bac6-6f5894e7052c tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:23.337674 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6b34ad38-50ba-4581-bac6-6f5894e7052c tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:23.338696 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6b34ad38-50ba-4581-bac6-6f5894e7052c tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:23.340064 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6b34ad38-50ba-4581-bac6-6f5894e7052c tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:23.340911 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6b34ad38-50ba-4581-bac6-6f5894e7052c tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:23.341633 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6b34ad38-50ba-4581-bac6-6f5894e7052c tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:23.358563 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-27588239-18c1-4390-87e1-a429af615c7e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:23.361613 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:55:23.370112 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-27588239-18c1-4390-87e1-a429af615c7e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:23.371776 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-27588239-18c1-4390-87e1-a429af615c7e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:23.372994 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-27588239-18c1-4390-87e1-a429af615c7e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1725 microversion: 2.20 time: 0.220925 Sep 12 23:55:23.373572 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 105/215] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:55:23 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1725 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:55:23.378654 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-bda99159-7ba5-48fd-85fa-fb41426752bd tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:23.379128 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-bda99159-7ba5-48fd-85fa-fb41426752bd tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 695586a7-2b4d-477b-ab83-9e74f5f7078a] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:23.387163 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bda99159-7ba5-48fd-85fa-fb41426752bd tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:23.388018 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bda99159-7ba5-48fd-85fa-fb41426752bd tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:23.388457 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bda99159-7ba5-48fd-85fa-fb41426752bd tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:23.389192 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bda99159-7ba5-48fd-85fa-fb41426752bd tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:23.389648 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bda99159-7ba5-48fd-85fa-fb41426752bd tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:23.390065 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bda99159-7ba5-48fd-85fa-fb41426752bd tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:23.461291 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-6b34ad38-50ba-4581-bac6-6f5894e7052c tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76b3353ce4b4361872ed6dba9f895d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f7d1c88224ebd85d15f7c43e7fe72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:23.476710 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-6b34ad38-50ba-4581-bac6-6f5894e7052c tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a" status: 200 len: 1311 microversion: 2.1 time: 0.162939 Sep 12 23:55:23.477966 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 111/216] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:23 2022] GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a => generated 1311 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:23.571389 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-bda99159-7ba5-48fd-85fa-fb41426752bd tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:23.579803 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-bda99159-7ba5-48fd-85fa-fb41426752bd tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a" status: 200 len: 1523 microversion: 2.1 time: 0.205089 Sep 12 23:55:23.580513 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 106/217] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:23 2022] GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a => generated 1523 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:24.134239 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-be0bbc0f-a4b5-4f08-825b-7bbfbe5b0dec tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:24.135185 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-be0bbc0f-a4b5-4f08-825b-7bbfbe5b0dec tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:24.142983 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-be0bbc0f-a4b5-4f08-825b-7bbfbe5b0dec tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:24.144695 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-be0bbc0f-a4b5-4f08-825b-7bbfbe5b0dec tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:24.145342 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-be0bbc0f-a4b5-4f08-825b-7bbfbe5b0dec tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:24.146922 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-be0bbc0f-a4b5-4f08-825b-7bbfbe5b0dec tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:24.147638 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-be0bbc0f-a4b5-4f08-825b-7bbfbe5b0dec tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:24.148222 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-be0bbc0f-a4b5-4f08-825b-7bbfbe5b0dec tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:24.236965 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-be0bbc0f-a4b5-4f08-825b-7bbfbe5b0dec tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:24.249336 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-be0bbc0f-a4b5-4f08-825b-7bbfbe5b0dec tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c" status: 200 len: 1293 microversion: 2.1 time: 0.119520 Sep 12 23:55:24.251155 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 112/218] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:24 2022] GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c => generated 1293 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:24.413642 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-402513c4-e162-4e90-bc70-7f6c5f9a04cb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:24.414429 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-402513c4-e162-4e90-bc70-7f6c5f9a04cb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:24.419283 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=5 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:55:24.425756 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-402513c4-e162-4e90-bc70-7f6c5f9a04cb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:24.426629 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-402513c4-e162-4e90-bc70-7f6c5f9a04cb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:24.427340 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-402513c4-e162-4e90-bc70-7f6c5f9a04cb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:24.429092 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-402513c4-e162-4e90-bc70-7f6c5f9a04cb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:24.430122 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-402513c4-e162-4e90-bc70-7f6c5f9a04cb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:24.431110 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-402513c4-e162-4e90-bc70-7f6c5f9a04cb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:24.522544 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d0c95b3b-9af1-41b6-9a9d-d90770112279 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:24.524411 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d0c95b3b-9af1-41b6-9a9d-d90770112279 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] [instance: c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:24.544994 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0c95b3b-9af1-41b6-9a9d-d90770112279 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:24.546243 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0c95b3b-9af1-41b6-9a9d-d90770112279 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:24.547209 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0c95b3b-9af1-41b6-9a9d-d90770112279 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:24.548532 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0c95b3b-9af1-41b6-9a9d-d90770112279 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:24.549497 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0c95b3b-9af1-41b6-9a9d-d90770112279 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:24.550611 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0c95b3b-9af1-41b6-9a9d-d90770112279 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:24.576670 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:55:24.722195 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d0c95b3b-9af1-41b6-9a9d-d90770112279 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76b3353ce4b4361872ed6dba9f895d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f7d1c88224ebd85d15f7c43e7fe72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:24.731714 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d0c95b3b-9af1-41b6-9a9d-d90770112279 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a" status: 200 len: 1311 microversion: 2.1 time: 0.218024 Sep 12 23:55:24.732972 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 113/219] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:24 2022] GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a => generated 1311 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:55:24.734864 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-402513c4-e162-4e90-bc70-7f6c5f9a04cb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:24.738466 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8cf569d3-b04d-40a2-b0e4-1a4a5eebed62 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:24.739472 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8cf569d3-b04d-40a2-b0e4-1a4a5eebed62 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 695586a7-2b4d-477b-ab83-9e74f5f7078a] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:24.747573 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-402513c4-e162-4e90-bc70-7f6c5f9a04cb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:24.752348 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-402513c4-e162-4e90-bc70-7f6c5f9a04cb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:24.752674 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8cf569d3-b04d-40a2-b0e4-1a4a5eebed62 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:24.753447 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8cf569d3-b04d-40a2-b0e4-1a4a5eebed62 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:24.754794 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8cf569d3-b04d-40a2-b0e4-1a4a5eebed62 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:24.755084 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-402513c4-e162-4e90-bc70-7f6c5f9a04cb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1725 microversion: 2.20 time: 0.349005 Sep 12 23:55:24.756027 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 107/220] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:55:24 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1725 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:55:24.757743 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8cf569d3-b04d-40a2-b0e4-1a4a5eebed62 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:24.758365 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8cf569d3-b04d-40a2-b0e4-1a4a5eebed62 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:24.758835 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8cf569d3-b04d-40a2-b0e4-1a4a5eebed62 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:25.096289 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8cf569d3-b04d-40a2-b0e4-1a4a5eebed62 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:25.110595 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8cf569d3-b04d-40a2-b0e4-1a4a5eebed62 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a" status: 200 len: 1523 microversion: 2.1 time: 0.375472 Sep 12 23:55:25.112099 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 114/221] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:24 2022] GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a => generated 1523 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:25.289866 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8a4a1ec1-d093-49d7-968d-f57d579ff57e tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:25.291330 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-8a4a1ec1-d093-49d7-968d-f57d579ff57e tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:25.300132 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8a4a1ec1-d093-49d7-968d-f57d579ff57e tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:25.300633 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8a4a1ec1-d093-49d7-968d-f57d579ff57e tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:25.301097 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8a4a1ec1-d093-49d7-968d-f57d579ff57e tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:25.302020 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8a4a1ec1-d093-49d7-968d-f57d579ff57e tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:25.302477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8a4a1ec1-d093-49d7-968d-f57d579ff57e tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:25.302905 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8a4a1ec1-d093-49d7-968d-f57d579ff57e tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:25.515990 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8a4a1ec1-d093-49d7-968d-f57d579ff57e tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:25.531508 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-8a4a1ec1-d093-49d7-968d-f57d579ff57e tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c" status: 200 len: 1361 microversion: 2.1 time: 0.246280 Sep 12 23:55:25.532672 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 108/222] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:25 2022] GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c => generated 1361 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:25.793220 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-29d81279-3ccf-45ec-b98b-7efcf20ca34c tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:25.794597 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-29d81279-3ccf-45ec-b98b-7efcf20ca34c tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] [instance: c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:25.801872 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-bf740c81-7c61-4d23-bdb2-5e60d1304324 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:25.802535 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-bf740c81-7c61-4d23-bdb2-5e60d1304324 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:25.809764 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bf740c81-7c61-4d23-bdb2-5e60d1304324 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:25.810340 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bf740c81-7c61-4d23-bdb2-5e60d1304324 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:25.810875 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bf740c81-7c61-4d23-bdb2-5e60d1304324 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:25.811893 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bf740c81-7c61-4d23-bdb2-5e60d1304324 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:25.812437 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bf740c81-7c61-4d23-bdb2-5e60d1304324 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:25.813011 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bf740c81-7c61-4d23-bdb2-5e60d1304324 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:25.822659 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-29d81279-3ccf-45ec-b98b-7efcf20ca34c tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:25.823895 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-29d81279-3ccf-45ec-b98b-7efcf20ca34c tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:25.826124 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-29d81279-3ccf-45ec-b98b-7efcf20ca34c tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:25.827666 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-29d81279-3ccf-45ec-b98b-7efcf20ca34c tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:25.828568 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-29d81279-3ccf-45ec-b98b-7efcf20ca34c tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:25.829396 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-29d81279-3ccf-45ec-b98b-7efcf20ca34c tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:25.954841 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-29d81279-3ccf-45ec-b98b-7efcf20ca34c tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76b3353ce4b4361872ed6dba9f895d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f7d1c88224ebd85d15f7c43e7fe72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:25.979968 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-29d81279-3ccf-45ec-b98b-7efcf20ca34c tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a" status: 200 len: 1311 microversion: 2.1 time: 0.206427 Sep 12 23:55:25.981700 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 115/223] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:25 2022] GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a => generated 1311 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:55:26.078669 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-bf740c81-7c61-4d23-bdb2-5e60d1304324 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:26.095292 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-bf740c81-7c61-4d23-bdb2-5e60d1304324 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:26.096907 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-bf740c81-7c61-4d23-bdb2-5e60d1304324 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:26.098209 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-bf740c81-7c61-4d23-bdb2-5e60d1304324 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1725 microversion: 2.20 time: 0.300926 Sep 12 23:55:26.098800 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 109/224] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:55:25 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1725 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:55:26.154722 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a867ffbd-0d4e-4053-9730-e40104ddd4b2 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:26.155964 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a867ffbd-0d4e-4053-9730-e40104ddd4b2 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 695586a7-2b4d-477b-ab83-9e74f5f7078a] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:26.167273 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a867ffbd-0d4e-4053-9730-e40104ddd4b2 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:26.167873 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a867ffbd-0d4e-4053-9730-e40104ddd4b2 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:26.168520 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a867ffbd-0d4e-4053-9730-e40104ddd4b2 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:26.169698 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a867ffbd-0d4e-4053-9730-e40104ddd4b2 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:26.170514 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a867ffbd-0d4e-4053-9730-e40104ddd4b2 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:26.171308 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a867ffbd-0d4e-4053-9730-e40104ddd4b2 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:26.360162 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a867ffbd-0d4e-4053-9730-e40104ddd4b2 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:26.370603 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a867ffbd-0d4e-4053-9730-e40104ddd4b2 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a" status: 200 len: 1523 microversion: 2.1 time: 0.223193 Sep 12 23:55:26.371442 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 116/225] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:26 2022] GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a => generated 1523 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:26.571644 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c05422f4-6bc9-4661-8f1e-bd035f81c11c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:26.572617 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c05422f4-6bc9-4661-8f1e-bd035f81c11c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:26.580170 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c05422f4-6bc9-4661-8f1e-bd035f81c11c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:26.580678 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c05422f4-6bc9-4661-8f1e-bd035f81c11c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:26.581127 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c05422f4-6bc9-4661-8f1e-bd035f81c11c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:26.581896 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c05422f4-6bc9-4661-8f1e-bd035f81c11c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:26.582370 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c05422f4-6bc9-4661-8f1e-bd035f81c11c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:26.582798 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c05422f4-6bc9-4661-8f1e-bd035f81c11c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:26.743805 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c05422f4-6bc9-4661-8f1e-bd035f81c11c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:26.752195 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c05422f4-6bc9-4661-8f1e-bd035f81c11c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c" status: 200 len: 1361 microversion: 2.1 time: 0.184715 Sep 12 23:55:26.752789 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 110/226] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:26 2022] GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c => generated 1361 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:27.025721 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8d43f7f4-df39-459b-bd09-bf2a74a00d1f tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:27.026369 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8d43f7f4-df39-459b-bd09-bf2a74a00d1f tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] [instance: c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:27.029664 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell0:SELECT=2 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:55:27.036148 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d43f7f4-df39-459b-bd09-bf2a74a00d1f tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:27.036702 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d43f7f4-df39-459b-bd09-bf2a74a00d1f tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:27.037193 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d43f7f4-df39-459b-bd09-bf2a74a00d1f tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:27.037962 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d43f7f4-df39-459b-bd09-bf2a74a00d1f tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:27.038477 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d43f7f4-df39-459b-bd09-bf2a74a00d1f tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:27.038957 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d43f7f4-df39-459b-bd09-bf2a74a00d1f tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:27.124023 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8d43f7f4-df39-459b-bd09-bf2a74a00d1f tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76b3353ce4b4361872ed6dba9f895d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f7d1c88224ebd85d15f7c43e7fe72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:27.128173 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-108ab89d-0141-435f-91f3-b22648eb8302 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:27.129238 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-108ab89d-0141-435f-91f3-b22648eb8302 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:27.134656 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8d43f7f4-df39-459b-bd09-bf2a74a00d1f tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a" status: 200 len: 1311 microversion: 2.1 time: 0.115089 Sep 12 23:55:27.151589 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-108ab89d-0141-435f-91f3-b22648eb8302 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:27.152246 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 117/227] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:27 2022] GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a => generated 1311 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:27.154666 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-108ab89d-0141-435f-91f3-b22648eb8302 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:27.155592 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-108ab89d-0141-435f-91f3-b22648eb8302 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:27.156865 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-108ab89d-0141-435f-91f3-b22648eb8302 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:27.157818 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-108ab89d-0141-435f-91f3-b22648eb8302 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:27.158565 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-108ab89d-0141-435f-91f3-b22648eb8302 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:27.409490 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-bddccb5d-d127-49ee-a1b8-b88fdeebbc95 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:27.411789 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-bddccb5d-d127-49ee-a1b8-b88fdeebbc95 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 695586a7-2b4d-477b-ab83-9e74f5f7078a] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:27.422287 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bddccb5d-d127-49ee-a1b8-b88fdeebbc95 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:27.423184 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bddccb5d-d127-49ee-a1b8-b88fdeebbc95 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:27.423751 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bddccb5d-d127-49ee-a1b8-b88fdeebbc95 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:27.424717 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bddccb5d-d127-49ee-a1b8-b88fdeebbc95 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:27.425463 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bddccb5d-d127-49ee-a1b8-b88fdeebbc95 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:27.425874 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bddccb5d-d127-49ee-a1b8-b88fdeebbc95 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:27.640901 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-108ab89d-0141-435f-91f3-b22648eb8302 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:27.650987 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-108ab89d-0141-435f-91f3-b22648eb8302 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:27.653295 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-108ab89d-0141-435f-91f3-b22648eb8302 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:27.654953 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-108ab89d-0141-435f-91f3-b22648eb8302 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1725 microversion: 2.20 time: 0.534201 Sep 12 23:55:27.656324 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 111/228] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:55:27 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1725 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 23:55:27.748592 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-bddccb5d-d127-49ee-a1b8-b88fdeebbc95 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:27.766243 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-bddccb5d-d127-49ee-a1b8-b88fdeebbc95 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a" status: 200 len: 1523 microversion: 2.1 time: 0.362692 Sep 12 23:55:27.779259 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 118/229] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:27 2022] GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a => generated 1523 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:27.790075 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-280ba512-7ac8-4de4-8a84-b5bb004ab869 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:27.790075 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-280ba512-7ac8-4de4-8a84-b5bb004ab869 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:27.790911 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-280ba512-7ac8-4de4-8a84-b5bb004ab869 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:27.791784 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-280ba512-7ac8-4de4-8a84-b5bb004ab869 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:27.792398 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-280ba512-7ac8-4de4-8a84-b5bb004ab869 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:27.793397 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-280ba512-7ac8-4de4-8a84-b5bb004ab869 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:27.800124 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-280ba512-7ac8-4de4-8a84-b5bb004ab869 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:27.800845 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-280ba512-7ac8-4de4-8a84-b5bb004ab869 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:28.166121 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-67475094-b7b0-4378-9f19-aa501ce9e031 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:28.167014 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-67475094-b7b0-4378-9f19-aa501ce9e031 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] [instance: c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:28.168239 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-280ba512-7ac8-4de4-8a84-b5bb004ab869 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:28.178719 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-67475094-b7b0-4378-9f19-aa501ce9e031 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:28.183555 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-67475094-b7b0-4378-9f19-aa501ce9e031 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:28.184546 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-67475094-b7b0-4378-9f19-aa501ce9e031 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:28.186049 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-67475094-b7b0-4378-9f19-aa501ce9e031 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:28.186731 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-67475094-b7b0-4378-9f19-aa501ce9e031 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:28.187299 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-67475094-b7b0-4378-9f19-aa501ce9e031 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:28.204979 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-280ba512-7ac8-4de4-8a84-b5bb004ab869 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c" status: 200 len: 1361 microversion: 2.1 time: 0.432285 Sep 12 23:55:28.221476 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 112/230] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:27 2022] GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c => generated 1361 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:28.305969 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-67475094-b7b0-4378-9f19-aa501ce9e031 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76b3353ce4b4361872ed6dba9f895d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f7d1c88224ebd85d15f7c43e7fe72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:28.332240 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-67475094-b7b0-4378-9f19-aa501ce9e031 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a" status: 200 len: 1311 microversion: 2.1 time: 0.169087 Sep 12 23:55:28.343371 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 119/231] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:28 2022] GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a => generated 1311 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:55:28.570777 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-dad51127-040e-43a5-a37f-cc41b7ee486a req-105985f4-fbc6-4c3f-ba97-08e0c962bdc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df2886ea-3e42-4713-82e6-bacd4de26d8c", "tag": "c4502ec9-84fa-4339-b714-5cfae4677e4e"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:55:28.599756 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell0:SELECT=2 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:55:28.600699 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell0:SELECT=14 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:55:28.619092 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-dad51127-040e-43a5-a37f-cc41b7ee486a req-105985f4-fbc6-4c3f-ba97-08e0c962bdc0 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:28.619810 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-dad51127-040e-43a5-a37f-cc41b7ee486a req-105985f4-fbc6-4c3f-ba97-08e0c962bdc0 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:28.620375 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-dad51127-040e-43a5-a37f-cc41b7ee486a req-105985f4-fbc6-4c3f-ba97-08e0c962bdc0 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:28.654763 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-dad51127-040e-43a5-a37f-cc41b7ee486a req-105985f4-fbc6-4c3f-ba97-08e0c962bdc0 service nova] Creating event network-changed:c4502ec9-84fa-4339-b714-5cfae4677e4e for instance df2886ea-3e42-4713-82e6-bacd4de26d8c on hv-cinder-82002 Sep 12 23:55:28.663035 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-dad51127-040e-43a5-a37f-cc41b7ee486a req-105985f4-fbc6-4c3f-ba97-08e0c962bdc0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097761 Sep 12 23:55:28.664597 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 113/232] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:55:28.683992 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-093f1a48-bb77-4803-8e2e-658d75253230 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:28.685077 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-093f1a48-bb77-4803-8e2e-658d75253230 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:28.692307 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell0:SELECT=10 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:55:28.694715 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-093f1a48-bb77-4803-8e2e-658d75253230 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:28.695261 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-093f1a48-bb77-4803-8e2e-658d75253230 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:28.695705 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-093f1a48-bb77-4803-8e2e-658d75253230 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:28.696538 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-093f1a48-bb77-4803-8e2e-658d75253230 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:28.697206 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-093f1a48-bb77-4803-8e2e-658d75253230 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:28.697635 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-093f1a48-bb77-4803-8e2e-658d75253230 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:28.804737 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-62b792f9-4c18-4d5d-9cc0-cb72a719071e tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:28.805823 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-62b792f9-4c18-4d5d-9cc0-cb72a719071e tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 695586a7-2b4d-477b-ab83-9e74f5f7078a] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:28.814264 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-62b792f9-4c18-4d5d-9cc0-cb72a719071e tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:28.815374 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-62b792f9-4c18-4d5d-9cc0-cb72a719071e tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:28.816716 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-62b792f9-4c18-4d5d-9cc0-cb72a719071e tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:28.817688 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-62b792f9-4c18-4d5d-9cc0-cb72a719071e tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:28.818658 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-62b792f9-4c18-4d5d-9cc0-cb72a719071e tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:28.819571 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-62b792f9-4c18-4d5d-9cc0-cb72a719071e tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:29.070244 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-093f1a48-bb77-4803-8e2e-658d75253230 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:29.114624 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-093f1a48-bb77-4803-8e2e-658d75253230 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:29.117449 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-093f1a48-bb77-4803-8e2e-658d75253230 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:29.139963 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-093f1a48-bb77-4803-8e2e-658d75253230 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1725 microversion: 2.20 time: 0.440297 Sep 12 23:55:29.145805 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 120/233] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:55:28 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1725 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:55:29.253023 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9b857086-a996-4926-a1ef-5d70d016a357 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:29.258886 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9b857086-a996-4926-a1ef-5d70d016a357 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:29.287051 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9b857086-a996-4926-a1ef-5d70d016a357 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:29.288676 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9b857086-a996-4926-a1ef-5d70d016a357 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:29.292930 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9b857086-a996-4926-a1ef-5d70d016a357 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:29.294186 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9b857086-a996-4926-a1ef-5d70d016a357 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:29.304873 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9b857086-a996-4926-a1ef-5d70d016a357 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:29.306378 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9b857086-a996-4926-a1ef-5d70d016a357 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:30.061523 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-62b792f9-4c18-4d5d-9cc0-cb72a719071e tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:30.087073 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-62b792f9-4c18-4d5d-9cc0-cb72a719071e tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a" status: 200 len: 1503 microversion: 2.1 time: 1.286565 Sep 12 23:55:30.087988 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 114/234] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:28 2022] GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a => generated 1503 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:30.127079 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7b2a7481-4874-45f5-b8d5-b516810486a0 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:30.128183 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7b2a7481-4874-45f5-b8d5-b516810486a0 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] [instance: c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:30.140154 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7b2a7481-4874-45f5-b8d5-b516810486a0 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:30.140981 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7b2a7481-4874-45f5-b8d5-b516810486a0 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:30.141708 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7b2a7481-4874-45f5-b8d5-b516810486a0 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:30.142948 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7b2a7481-4874-45f5-b8d5-b516810486a0 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:30.143747 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7b2a7481-4874-45f5-b8d5-b516810486a0 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:30.144449 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7b2a7481-4874-45f5-b8d5-b516810486a0 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:30.340900 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7b2a7481-4874-45f5-b8d5-b516810486a0 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76b3353ce4b4361872ed6dba9f895d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f7d1c88224ebd85d15f7c43e7fe72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:30.365200 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7b2a7481-4874-45f5-b8d5-b516810486a0 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a" status: 200 len: 1317 microversion: 2.1 time: 0.258929 Sep 12 23:55:30.366777 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 115/235] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:30 2022] GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a => generated 1317 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:30.377676 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d728b646-c267-4071-bf50-1dc4f72e84ba tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Action: 'create', calling method: .version_select at 0x7fed0160d550>, body: {"keypair": {"name": "tempest-keypair-2034339834", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFdvlAiEENrsKxKBVRYKAhUslVnUX4qHE/J+VzPbuAZK6gLqqfEofPJOCvTJaW8lSPf6uLJKkCpxPQedOz7GNGH+S2Jjupb33c59fFrmpNvx/RjZSHxi6i4J3Kk/SaHkw=="}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:55:30.414304 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-d728b646-c267-4071-bf50-1dc4f72e84ba tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Getting quotas for project 6c681f1232de4a5fbfc728c230f80624. Resources: {'key_pairs'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 23:55:30.424413 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-d728b646-c267-4071-bf50-1dc4f72e84ba tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Getting quotas for user a8cbfc74644f4d4594a70b833ad7002c and project 6c681f1232de4a5fbfc728c230f80624. Resources: {'key_pairs'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 23:55:30.484175 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d728b646-c267-4071-bf50-1dc4f72e84ba tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.113549 Sep 12 23:55:30.486981 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 116/236] 10.222.0.26 () {60 vars in 1159 bytes} [Mon Sep 12 23:55:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:55:30.504611 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-682c615a-10ec-476e-98cc-735fc6be4330 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d21fae0c-5ad7-4ad0-b580-48a16ae38042"}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:55:30.511209 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-682c615a-10ec-476e-98cc-735fc6be4330 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 695586a7-2b4d-477b-ab83-9e74f5f7078a] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:30.541786 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-682c615a-10ec-476e-98cc-735fc6be4330 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:30.544856 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-682c615a-10ec-476e-98cc-735fc6be4330 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:30.555694 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-682c615a-10ec-476e-98cc-735fc6be4330 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:30.559566 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-682c615a-10ec-476e-98cc-735fc6be4330 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:30.561201 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-682c615a-10ec-476e-98cc-735fc6be4330 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:30.563117 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-682c615a-10ec-476e-98cc-735fc6be4330 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:30.634329 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9b857086-a996-4926-a1ef-5d70d016a357 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:30.644780 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9b857086-a996-4926-a1ef-5d70d016a357 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c" status: 200 len: 1361 microversion: 2.1 time: 1.401549 Sep 12 23:55:30.664865 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 121/237] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:29 2022] GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c => generated 1361 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:30.691084 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f60eb226-8dcc-470a-92d6-a2379f6a0d2a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:30.692629 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-682c615a-10ec-476e-98cc-735fc6be4330 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] HTTP exception thrown: Cannot 'attach_volume' instance 695586a7-2b4d-477b-ab83-9e74f5f7078a while it is in vm_state rescued Sep 12 23:55:30.695533 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f60eb226-8dcc-470a-92d6-a2379f6a0d2a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:30.698610 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-682c615a-10ec-476e-98cc-735fc6be4330 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Request method failure captured: Sep 12 23:55:30.698610 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: request: POST /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a/os-volume_attachments HTTP/1.1 Sep 12 23:55:30.698610 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Accept: application/json Sep 12 23:55:30.698610 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Sep 12 23:55:30.698610 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Connection: close Sep 12 23:55:30.698610 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Content-Length: 74 Sep 12 23:55:30.698610 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Content-Type: application/json Sep 12 23:55:30.698610 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Host: 10.222.0.26 Sep 12 23:55:30.698610 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Sep 12 23:55:30.698610 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Sep 12 23:55:30.698610 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjH8ZuStW1XXoPQe5y95eOpKYZF0F7YBvJw_27e2kYLBySngK1oyC8cbK16WrSBBy5I-zldm72baODkX7E0kbSH3YQJRovD2YiBAj_9m-miREAelhxMrO-4StKyBWO2wiypQKnAsHCgsduOcFVztxSrPSWmh7ZuLOXLc3LDIycAkgHl0E Sep 12 23:55:30.698610 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Sep 12 23:55:30.698610 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Sep 12 23:55:30.698610 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Sep 12 23:55:30.698610 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Sep 12 23:55:30.698610 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Sep 12 23:55:30.698610 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Sep 12 23:55:30.698610 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Id: 6c458cf41ded4113a09fb07e10d81d39 Sep 12 23:55:30.698610 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2096714212 Sep 12 23:55:30.698610 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Role: member,reader Sep 12 23:55:30.698610 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Roles: member,reader Sep 12 23:55:30.701246 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6c458cf41ded4113a09fb07e10d81d39"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6c458cf41ded4113a09fb07e10d81d39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6c458cf41ded4113a09fb07e10d81d39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6c458cf41ded4113a09fb07e10d81d39"}]}] Sep 12 23:55:30.701246 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2096714212 Sep 12 23:55:30.701246 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant-Id: 6c458cf41ded4113a09fb07e10d81d39 Sep 12 23:55:30.701246 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2096714212 Sep 12 23:55:30.701246 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User: tempest-ServerRescueNegativeTestJSON-2096714212-project Sep 12 23:55:30.701246 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Sep 12 23:55:30.701246 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Sep 12 23:55:30.701246 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Id: 76eb39c2010e43aaa0a01caaea3a38b9 Sep 12 23:55:30.701246 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2096714212-project Sep 12 23:55:30.701246 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Sep 12 23:55:30.701246 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: {"volumeAttachment": {"volumeId": "d21fae0c-5ad7-4ad0-b580-48a16ae38042"}} Sep 12 23:55:30.701246 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: method: > Sep 12 23:55:30.702635 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: exception: Cannot 'attach_volume' instance 695586a7-2b4d-477b-ab83-9e74f5f7078a while it is in vm_state rescued Sep 12 23:55:30.702635 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: action_args: {'server_id': '695586a7-2b4d-477b-ab83-9e74f5f7078a', 'body': {'volumeAttachment': {'volumeId': 'd21fae0c-5ad7-4ad0-b580-48a16ae38042'}}} Sep 12 23:55:30.702635 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:55:30.702635 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:55:30.702635 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 12 23:55:30.702635 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 12 23:55:30.702635 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 12 23:55:30.702635 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 12 23:55:30.702635 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 12 23:55:30.702635 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 12 23:55:30.702635 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 695586a7-2b4d-477b-ab83-9e74f5f7078a in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 12 23:55:30.702635 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:55:30.702635 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:55:30.702635 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:55:30.702635 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:55:30.702635 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:55:30.702635 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:55:30.702635 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:55:30.702635 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:55:30.708699 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:55:30.708699 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:55:30.708699 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 12 23:55:30.708699 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 12 23:55:30.708699 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 12 23:55:30.708699 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 12 23:55:30.708699 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 12 23:55:30.708699 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 12 23:55:30.708699 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 12 23:55:30.708699 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 12 23:55:30.708699 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 12 23:55:30.708699 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 12 23:55:30.708699 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 695586a7-2b4d-477b-ab83-9e74f5f7078a while it is in vm_state rescued Sep 12 23:55:30.708699 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:55:30.708699 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:55:30.708699 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:55:30.708699 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:55:30.708699 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:55:30.708699 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:55:30.714910 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:55:30.714910 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:55:30.714910 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 695586a7-2b4d-477b-ab83-9e74f5f7078a while it is in vm_state rescued Sep 12 23:55:30.714910 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:55:30.718023 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-682c615a-10ec-476e-98cc-735fc6be4330 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Returning 409 to user: Cannot 'attach_volume' instance 695586a7-2b4d-477b-ab83-9e74f5f7078a while it is in vm_state rescued {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:55:30.720308 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-682c615a-10ec-476e-98cc-735fc6be4330 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "POST /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.229278 Sep 12 23:55:30.722951 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 117/238] 10.222.0.26 () {60 vars in 1323 bytes} [Mon Sep 12 23:55:30 2022] POST /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a/os-volume_attachments => generated 152 bytes in 234 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 12 23:55:30.724638 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f60eb226-8dcc-470a-92d6-a2379f6a0d2a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:30.725129 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f60eb226-8dcc-470a-92d6-a2379f6a0d2a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:30.725600 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f60eb226-8dcc-470a-92d6-a2379f6a0d2a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:30.735420 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f60eb226-8dcc-470a-92d6-a2379f6a0d2a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:30.736238 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f60eb226-8dcc-470a-92d6-a2379f6a0d2a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:30.742145 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f60eb226-8dcc-470a-92d6-a2379f6a0d2a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:30.749264 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-364ceb75-da06-47fa-8e78-a0de38976d2b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:55:30.750941 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-364ceb75-da06-47fa-8e78-a0de38976d2b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 695586a7-2b4d-477b-ab83-9e74f5f7078a] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:30.770897 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-364ceb75-da06-47fa-8e78-a0de38976d2b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:30.776232 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-364ceb75-da06-47fa-8e78-a0de38976d2b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:30.778311 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-364ceb75-da06-47fa-8e78-a0de38976d2b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:30.780924 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-364ceb75-da06-47fa-8e78-a0de38976d2b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:30.781371 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-364ceb75-da06-47fa-8e78-a0de38976d2b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:30.783700 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-364ceb75-da06-47fa-8e78-a0de38976d2b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:31.124958 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-364ceb75-da06-47fa-8e78-a0de38976d2b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "POST /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a/action" status: 202 len: 0 microversion: 2.1 time: 0.391401 Sep 12 23:55:31.128988 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 118/239] 10.222.0.26 () {60 vars in 1278 bytes} [Mon Sep 12 23:55:30 2022] POST /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a/action => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 12 23:55:31.161454 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-15859c1e-9577-4300-8d34-a0dcd2b54173 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:31.167936 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-15859c1e-9577-4300-8d34-a0dcd2b54173 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 695586a7-2b4d-477b-ab83-9e74f5f7078a] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:31.182243 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-15859c1e-9577-4300-8d34-a0dcd2b54173 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:31.186184 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-15859c1e-9577-4300-8d34-a0dcd2b54173 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:31.189350 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-15859c1e-9577-4300-8d34-a0dcd2b54173 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:31.192061 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-15859c1e-9577-4300-8d34-a0dcd2b54173 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:31.192944 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-15859c1e-9577-4300-8d34-a0dcd2b54173 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:31.193665 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-15859c1e-9577-4300-8d34-a0dcd2b54173 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:31.684645 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f60eb226-8dcc-470a-92d6-a2379f6a0d2a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:31.697740 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f60eb226-8dcc-470a-92d6-a2379f6a0d2a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:31.711844 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f60eb226-8dcc-470a-92d6-a2379f6a0d2a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:31.713226 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f60eb226-8dcc-470a-92d6-a2379f6a0d2a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1725 microversion: 2.20 time: 1.044308 Sep 12 23:55:31.713862 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 122/240] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:55:30 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1725 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:55:31.718917 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4577796a-09ab-4b3b-bc41-4d5b6efd78c3 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:31.719625 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4577796a-09ab-4b3b-bc41-4d5b6efd78c3 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] [instance: c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:31.736902 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4577796a-09ab-4b3b-bc41-4d5b6efd78c3 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:31.740177 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4577796a-09ab-4b3b-bc41-4d5b6efd78c3 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:31.740797 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4577796a-09ab-4b3b-bc41-4d5b6efd78c3 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:31.749554 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4577796a-09ab-4b3b-bc41-4d5b6efd78c3 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:31.750352 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4577796a-09ab-4b3b-bc41-4d5b6efd78c3 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:31.750794 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4577796a-09ab-4b3b-bc41-4d5b6efd78c3 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:31.926024 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4577796a-09ab-4b3b-bc41-4d5b6efd78c3 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76b3353ce4b4361872ed6dba9f895d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f7d1c88224ebd85d15f7c43e7fe72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:31.941070 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4577796a-09ab-4b3b-bc41-4d5b6efd78c3 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a" status: 200 len: 1317 microversion: 2.1 time: 0.225814 Sep 12 23:55:31.941993 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 123/241] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:31 2022] GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a => generated 1317 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:31.975350 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2f1c4476-2892-4251-8ebe-f229c578698c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:31.976315 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2f1c4476-2892-4251-8ebe-f229c578698c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:31.992948 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2f1c4476-2892-4251-8ebe-f229c578698c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:31.993742 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2f1c4476-2892-4251-8ebe-f229c578698c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:31.994546 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2f1c4476-2892-4251-8ebe-f229c578698c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:31.995554 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2f1c4476-2892-4251-8ebe-f229c578698c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:31.996211 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2f1c4476-2892-4251-8ebe-f229c578698c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:32.000010 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2f1c4476-2892-4251-8ebe-f229c578698c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:32.101699 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-15859c1e-9577-4300-8d34-a0dcd2b54173 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:32.118772 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-15859c1e-9577-4300-8d34-a0dcd2b54173 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a" status: 200 len: 1511 microversion: 2.1 time: 0.972889 Sep 12 23:55:32.132120 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 119/242] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:31 2022] GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a => generated 1511 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:32.509820 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2f1c4476-2892-4251-8ebe-f229c578698c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:32.542110 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2f1c4476-2892-4251-8ebe-f229c578698c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c" status: 200 len: 1361 microversion: 2.1 time: 0.577126 Sep 12 23:55:32.544073 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 124/243] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:31 2022] GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c => generated 1361 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:32.754508 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-856d1fe6-bf79-4054-949f-e9e27902060b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:32.758632 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-856d1fe6-bf79-4054-949f-e9e27902060b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:32.772035 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-856d1fe6-bf79-4054-949f-e9e27902060b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:32.772982 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-856d1fe6-bf79-4054-949f-e9e27902060b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:32.773766 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-856d1fe6-bf79-4054-949f-e9e27902060b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:32.775125 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-856d1fe6-bf79-4054-949f-e9e27902060b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:32.776506 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-856d1fe6-bf79-4054-949f-e9e27902060b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:32.777634 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-856d1fe6-bf79-4054-949f-e9e27902060b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:32.975633 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0059eefc-750d-4d20-8cb0-672fa1c04f42 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:32.979146 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0059eefc-750d-4d20-8cb0-672fa1c04f42 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] [instance: c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:32.995967 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0059eefc-750d-4d20-8cb0-672fa1c04f42 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:32.997818 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0059eefc-750d-4d20-8cb0-672fa1c04f42 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:32.999818 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0059eefc-750d-4d20-8cb0-672fa1c04f42 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:33.003283 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0059eefc-750d-4d20-8cb0-672fa1c04f42 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:33.004473 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0059eefc-750d-4d20-8cb0-672fa1c04f42 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:33.005478 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0059eefc-750d-4d20-8cb0-672fa1c04f42 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:33.085708 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-856d1fe6-bf79-4054-949f-e9e27902060b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:33.100111 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-856d1fe6-bf79-4054-949f-e9e27902060b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:33.102095 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-856d1fe6-bf79-4054-949f-e9e27902060b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:33.103791 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-856d1fe6-bf79-4054-949f-e9e27902060b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1725 microversion: 2.20 time: 0.363693 Sep 12 23:55:33.105067 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 120/244] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:55:32 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1725 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 23:55:33.159887 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ffa190df-e50e-4b11-98a7-a0972e03c2e2 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:33.161839 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ffa190df-e50e-4b11-98a7-a0972e03c2e2 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 695586a7-2b4d-477b-ab83-9e74f5f7078a] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:33.173714 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ffa190df-e50e-4b11-98a7-a0972e03c2e2 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:33.174428 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ffa190df-e50e-4b11-98a7-a0972e03c2e2 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:33.176782 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ffa190df-e50e-4b11-98a7-a0972e03c2e2 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:33.180001 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ffa190df-e50e-4b11-98a7-a0972e03c2e2 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:33.180879 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ffa190df-e50e-4b11-98a7-a0972e03c2e2 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:33.181748 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ffa190df-e50e-4b11-98a7-a0972e03c2e2 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:33.728649 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0059eefc-750d-4d20-8cb0-672fa1c04f42 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76b3353ce4b4361872ed6dba9f895d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f7d1c88224ebd85d15f7c43e7fe72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:33.741162 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0059eefc-750d-4d20-8cb0-672fa1c04f42 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a" status: 200 len: 1359 microversion: 2.1 time: 0.773597 Sep 12 23:55:33.741769 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 125/245] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:32 2022] GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a => generated 1359 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:33.755411 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5a29b080-d29a-455c-bb85-53648512936c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:33.764674 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5a29b080-d29a-455c-bb85-53648512936c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:33.792594 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5a29b080-d29a-455c-bb85-53648512936c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:33.793105 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5a29b080-d29a-455c-bb85-53648512936c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:33.797508 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5a29b080-d29a-455c-bb85-53648512936c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:33.802206 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5a29b080-d29a-455c-bb85-53648512936c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:33.803667 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5a29b080-d29a-455c-bb85-53648512936c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:33.804122 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5a29b080-d29a-455c-bb85-53648512936c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:33.934186 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ffa190df-e50e-4b11-98a7-a0972e03c2e2 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:33.967039 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ffa190df-e50e-4b11-98a7-a0972e03c2e2 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a" status: 200 len: 1511 microversion: 2.1 time: 0.815526 Sep 12 23:55:33.999253 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 121/246] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:33 2022] GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a => generated 1511 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:34.134775 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-63bcb064-f381-4f88-9870-0e34cd5fa1dd tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1998876491", "imageRef": "22a47167-5e04-441a-a504-d76d82afc776", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3c1b7b6d-23b0-4d33-9526-13eb374ddc8c"}], "security_groups": [{"name": "tempest-securitygroup--590236715"}], "key_name": "tempest-keypair-2034339834", "user_data": "}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:55:34.434753 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5a29b080-d29a-455c-bb85-53648512936c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:34.455639 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.network.neutron [None req-63bcb064-f381-4f88-9870-0e34cd5fa1dd tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] validate_networks() for [('3c1b7b6d-23b0-4d33-9526-13eb374ddc8c', None, None, None, None, None)] {{(pid=126976) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 23:55:34.463036 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5a29b080-d29a-455c-bb85-53648512936c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c" status: 200 len: 1361 microversion: 2.1 time: 0.717831 Sep 12 23:55:34.467817 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 126/247] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:33 2022] GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c => generated 1361 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:34.482511 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c70bb969-e105-494c-bbd1-463e0e408c0c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:34.488287 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c70bb969-e105-494c-bbd1-463e0e408c0c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:34.498194 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c70bb969-e105-494c-bbd1-463e0e408c0c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:34.500218 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c70bb969-e105-494c-bbd1-463e0e408c0c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:34.502350 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c70bb969-e105-494c-bbd1-463e0e408c0c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:34.505159 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c70bb969-e105-494c-bbd1-463e0e408c0c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:34.508044 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c70bb969-e105-494c-bbd1-463e0e408c0c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:34.508744 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c70bb969-e105-494c-bbd1-463e0e408c0c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:35.242845 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c70bb969-e105-494c-bbd1-463e0e408c0c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:35.256808 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c70bb969-e105-494c-bbd1-463e0e408c0c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:35.266797 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c70bb969-e105-494c-bbd1-463e0e408c0c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:35.278130 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c70bb969-e105-494c-bbd1-463e0e408c0c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1725 microversion: 2.20 time: 0.797530 Sep 12 23:55:35.280956 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 127/248] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:55:34 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1725 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:55:35.313042 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d0753607-35b7-45fb-a401-2920d08b940d tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:35.313574 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d0753607-35b7-45fb-a401-2920d08b940d tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] [instance: c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:35.352495 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0753607-35b7-45fb-a401-2920d08b940d tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:35.353075 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0753607-35b7-45fb-a401-2920d08b940d tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:35.356026 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0753607-35b7-45fb-a401-2920d08b940d tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:35.360121 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0753607-35b7-45fb-a401-2920d08b940d tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:35.364564 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0753607-35b7-45fb-a401-2920d08b940d tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:35.367320 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0753607-35b7-45fb-a401-2920d08b940d tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:37.143763 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d0753607-35b7-45fb-a401-2920d08b940d tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76b3353ce4b4361872ed6dba9f895d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f7d1c88224ebd85d15f7c43e7fe72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:37.160226 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d0753607-35b7-45fb-a401-2920d08b940d tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a" status: 200 len: 1359 microversion: 2.1 time: 1.874413 Sep 12 23:55:37.160722 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 128/249] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:35 2022] GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a => generated 1359 bytes in 1879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:37.165901 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e184b016-6a4d-4be4-9d94-50c47ca0ac04 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:37.179724 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e184b016-6a4d-4be4-9d94-50c47ca0ac04 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 695586a7-2b4d-477b-ab83-9e74f5f7078a] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:37.199965 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e184b016-6a4d-4be4-9d94-50c47ca0ac04 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:37.200829 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e184b016-6a4d-4be4-9d94-50c47ca0ac04 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:37.201505 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e184b016-6a4d-4be4-9d94-50c47ca0ac04 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:37.202480 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e184b016-6a4d-4be4-9d94-50c47ca0ac04 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:37.203145 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e184b016-6a4d-4be4-9d94-50c47ca0ac04 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:37.203799 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e184b016-6a4d-4be4-9d94-50c47ca0ac04 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:37.385031 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-63bcb064-f381-4f88-9870-0e34cd5fa1dd tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Flavor limits 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 23:55:37.386880 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-63bcb064-f381-4f88-9870-0e34cd5fa1dd tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Image limits 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 23:55:37.388154 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-63bcb064-f381-4f88-9870-0e34cd5fa1dd tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Flavor pref 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 23:55:37.389626 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-63bcb064-f381-4f88-9870-0e34cd5fa1dd tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Image pref 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 23:55:37.391290 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-63bcb064-f381-4f88-9870-0e34cd5fa1dd tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 23:55:37.461798 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-63bcb064-f381-4f88-9870-0e34cd5fa1dd tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:37.465959 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-63bcb064-f381-4f88-9870-0e34cd5fa1dd tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:37.467114 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-63bcb064-f381-4f88-9870-0e34cd5fa1dd tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:37.469096 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-63bcb064-f381-4f88-9870-0e34cd5fa1dd tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:37.470546 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-63bcb064-f381-4f88-9870-0e34cd5fa1dd tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:37.472137 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-63bcb064-f381-4f88-9870-0e34cd5fa1dd tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:37.524593 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-63bcb064-f381-4f88-9870-0e34cd5fa1dd tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Getting quotas for project 6c681f1232de4a5fbfc728c230f80624. Resources: {'instances', 'cores', 'ram'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 23:55:37.540475 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-63bcb064-f381-4f88-9870-0e34cd5fa1dd tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Getting quotas for user a8cbfc74644f4d4594a70b833ad7002c and project 6c681f1232de4a5fbfc728c230f80624. Resources: {'instances', 'cores', 'ram'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 23:55:37.590129 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-63bcb064-f381-4f88-9870-0e34cd5fa1dd tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Going to run 1 instances... {{(pid=126976) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 23:55:37.593176 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-63bcb064-f381-4f88-9870-0e34cd5fa1dd tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: ad5faa90-b5ff-47e2-abab-21418459ecde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='22a47167-5e04-441a-a504-d76d82afc776',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126976) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 23:55:37.683859 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-63bcb064-f381-4f88-9870-0e34cd5fa1dd tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.575428 Sep 12 23:55:37.684933 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 122/250] 10.222.0.26 () {60 vars in 1147 bytes} [Mon Sep 12 23:55:34 2022] POST /compute/v2.1/servers => generated 401 bytes in 3577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 12 23:55:37.690717 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2ac17acb-9c79-4ad7-bf61-8ea252d92421 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:37.692709 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2ac17acb-9c79-4ad7-bf61-8ea252d92421 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:37.716225 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2ac17acb-9c79-4ad7-bf61-8ea252d92421 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:37.716978 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2ac17acb-9c79-4ad7-bf61-8ea252d92421 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:37.717782 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2ac17acb-9c79-4ad7-bf61-8ea252d92421 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:37.718780 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2ac17acb-9c79-4ad7-bf61-8ea252d92421 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:37.719538 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2ac17acb-9c79-4ad7-bf61-8ea252d92421 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:37.720235 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2ac17acb-9c79-4ad7-bf61-8ea252d92421 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:39.329683 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2ac17acb-9c79-4ad7-bf61-8ea252d92421 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:39.343078 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2ac17acb-9c79-4ad7-bf61-8ea252d92421 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c" status: 200 len: 1361 microversion: 2.1 time: 1.654876 Sep 12 23:55:39.350022 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 123/251] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:37 2022] GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c => generated 1361 bytes in 1665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:39.380223 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8d0ba705-0dc5-46c1-a616-cc1babb9f782 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:39.382024 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-8d0ba705-0dc5-46c1-a616-cc1babb9f782 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:39.398038 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8d0ba705-0dc5-46c1-a616-cc1babb9f782 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:39.398558 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8d0ba705-0dc5-46c1-a616-cc1babb9f782 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:39.399005 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8d0ba705-0dc5-46c1-a616-cc1babb9f782 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:39.401573 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8d0ba705-0dc5-46c1-a616-cc1babb9f782 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:39.404197 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8d0ba705-0dc5-46c1-a616-cc1babb9f782 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:39.405111 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8d0ba705-0dc5-46c1-a616-cc1babb9f782 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:39.417498 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:55:39.613410 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e184b016-6a4d-4be4-9d94-50c47ca0ac04 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:39.647917 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:55:39.654964 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e184b016-6a4d-4be4-9d94-50c47ca0ac04 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a" status: 200 len: 1511 microversion: 2.1 time: 2.492621 Sep 12 23:55:39.664645 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 129/252] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:37 2022] GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a => generated 1511 bytes in 2496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:39.667754 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2cb39b7b-d2d9-47fc-8e0f-6f4cb841b572 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:39.669142 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2cb39b7b-d2d9-47fc-8e0f-6f4cb841b572 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: ad5faa90-b5ff-47e2-abab-21418459ecde] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:39.685052 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2cb39b7b-d2d9-47fc-8e0f-6f4cb841b572 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:39.685538 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2cb39b7b-d2d9-47fc-8e0f-6f4cb841b572 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:39.686875 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2cb39b7b-d2d9-47fc-8e0f-6f4cb841b572 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:39.688731 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2cb39b7b-d2d9-47fc-8e0f-6f4cb841b572 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:39.689735 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2cb39b7b-d2d9-47fc-8e0f-6f4cb841b572 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:39.691531 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2cb39b7b-d2d9-47fc-8e0f-6f4cb841b572 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:39.849261 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2cb39b7b-d2d9-47fc-8e0f-6f4cb841b572 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:39.862064 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2cb39b7b-d2d9-47fc-8e0f-6f4cb841b572 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde" status: 200 len: 1246 microversion: 2.1 time: 0.202507 Sep 12 23:55:39.866537 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8d0ba705-0dc5-46c1-a616-cc1babb9f782 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:39.875074 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 130/253] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:39 2022] GET /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde => generated 1246 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:39.884860 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8d0ba705-0dc5-46c1-a616-cc1babb9f782 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:39.894223 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8d0ba705-0dc5-46c1-a616-cc1babb9f782 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:39.894688 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-78a7cfef-5c45-407d-95b4-d6821e85cbc3 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:39.896305 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-78a7cfef-5c45-407d-95b4-d6821e85cbc3 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] [instance: c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:39.904715 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-8d0ba705-0dc5-46c1-a616-cc1babb9f782 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1741 microversion: 2.20 time: 0.535644 Sep 12 23:55:39.908227 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 124/254] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:55:39 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1741 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:55:39.914503 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-78a7cfef-5c45-407d-95b4-d6821e85cbc3 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:39.915407 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-78a7cfef-5c45-407d-95b4-d6821e85cbc3 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:39.916266 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-78a7cfef-5c45-407d-95b4-d6821e85cbc3 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:39.918655 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-78a7cfef-5c45-407d-95b4-d6821e85cbc3 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:39.920225 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-78a7cfef-5c45-407d-95b4-d6821e85cbc3 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:39.921442 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-78a7cfef-5c45-407d-95b4-d6821e85cbc3 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:40.104667 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-8db28be4-262e-4fac-af10-027e7456b38d req-ef9c102e-3fe3-45fc-8afa-f8537bc8154c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a", "tag": "57c9f24f-46a8-416f-96ec-1d08fd0338ff"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:55:40.122132 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-8db28be4-262e-4fac-af10-027e7456b38d req-ef9c102e-3fe3-45fc-8afa-f8537bc8154c service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:40.123506 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-8db28be4-262e-4fac-af10-027e7456b38d req-ef9c102e-3fe3-45fc-8afa-f8537bc8154c service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:40.124369 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-8db28be4-262e-4fac-af10-027e7456b38d req-ef9c102e-3fe3-45fc-8afa-f8537bc8154c service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:40.158954 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-8db28be4-262e-4fac-af10-027e7456b38d req-ef9c102e-3fe3-45fc-8afa-f8537bc8154c service nova] Creating event network-changed:57c9f24f-46a8-416f-96ec-1d08fd0338ff for instance c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a on hv-cinder-82002 Sep 12 23:55:40.181328 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-8db28be4-262e-4fac-af10-027e7456b38d req-ef9c102e-3fe3-45fc-8afa-f8537bc8154c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078440 Sep 12 23:55:40.182548 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 125/255] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 23:55:40.208219 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-78a7cfef-5c45-407d-95b4-d6821e85cbc3 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76b3353ce4b4361872ed6dba9f895d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f7d1c88224ebd85d15f7c43e7fe72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:40.217047 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-78a7cfef-5c45-407d-95b4-d6821e85cbc3 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a" status: 200 len: 1359 microversion: 2.1 time: 0.339624 Sep 12 23:55:40.219357 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 131/256] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:39 2022] GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a => generated 1359 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:40.378429 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-22b3ed59-c0bf-49db-92c6-aac0d8e6d3c0 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:40.380862 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-22b3ed59-c0bf-49db-92c6-aac0d8e6d3c0 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:40.391182 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-22b3ed59-c0bf-49db-92c6-aac0d8e6d3c0 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:40.393369 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-22b3ed59-c0bf-49db-92c6-aac0d8e6d3c0 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:40.394241 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-22b3ed59-c0bf-49db-92c6-aac0d8e6d3c0 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:40.395192 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-22b3ed59-c0bf-49db-92c6-aac0d8e6d3c0 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:40.396078 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-22b3ed59-c0bf-49db-92c6-aac0d8e6d3c0 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:40.396706 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-22b3ed59-c0bf-49db-92c6-aac0d8e6d3c0 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:40.591528 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-22b3ed59-c0bf-49db-92c6-aac0d8e6d3c0 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:40.604147 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-22b3ed59-c0bf-49db-92c6-aac0d8e6d3c0 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c" status: 200 len: 1361 microversion: 2.1 time: 0.234288 Sep 12 23:55:40.609838 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 126/257] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:40 2022] GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c => generated 1361 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:40.712840 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-6ed7afb6-c3ae-4d70-ae80-1997923585ff tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:40.713688 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-6ed7afb6-c3ae-4d70-ae80-1997923585ff tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 695586a7-2b4d-477b-ab83-9e74f5f7078a] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:40.720074 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6ed7afb6-c3ae-4d70-ae80-1997923585ff tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:40.720884 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6ed7afb6-c3ae-4d70-ae80-1997923585ff tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:40.722206 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6ed7afb6-c3ae-4d70-ae80-1997923585ff tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:40.722994 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6ed7afb6-c3ae-4d70-ae80-1997923585ff tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:40.723709 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6ed7afb6-c3ae-4d70-ae80-1997923585ff tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:40.724398 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6ed7afb6-c3ae-4d70-ae80-1997923585ff tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:40.933832 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7d5d25cd-9d7a-480d-8632-4d66bfbf361d tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:40.933832 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7d5d25cd-9d7a-480d-8632-4d66bfbf361d tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: ad5faa90-b5ff-47e2-abab-21418459ecde] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:40.934031 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-6ed7afb6-c3ae-4d70-ae80-1997923585ff tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:40.945382 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7d5d25cd-9d7a-480d-8632-4d66bfbf361d tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:40.945944 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-6ed7afb6-c3ae-4d70-ae80-1997923585ff tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a" status: 200 len: 1511 microversion: 2.1 time: 0.233748 Sep 12 23:55:40.946702 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 132/258] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:40 2022] GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a => generated 1511 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:55:40.966467 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7d5d25cd-9d7a-480d-8632-4d66bfbf361d tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:40.967064 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7d5d25cd-9d7a-480d-8632-4d66bfbf361d tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:40.968141 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7d5d25cd-9d7a-480d-8632-4d66bfbf361d tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:40.968723 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7d5d25cd-9d7a-480d-8632-4d66bfbf361d tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:40.970170 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7d5d25cd-9d7a-480d-8632-4d66bfbf361d tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:40.972606 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a1f0c8f4-a456-425d-b570-4c908d091854 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:40.973377 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a1f0c8f4-a456-425d-b570-4c908d091854 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:40.988491 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a1f0c8f4-a456-425d-b570-4c908d091854 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:40.989178 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a1f0c8f4-a456-425d-b570-4c908d091854 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:40.989712 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a1f0c8f4-a456-425d-b570-4c908d091854 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:40.990605 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a1f0c8f4-a456-425d-b570-4c908d091854 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:40.992008 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a1f0c8f4-a456-425d-b570-4c908d091854 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:40.993007 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a1f0c8f4-a456-425d-b570-4c908d091854 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:41.060672 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7d5d25cd-9d7a-480d-8632-4d66bfbf361d tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:41.072906 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7d5d25cd-9d7a-480d-8632-4d66bfbf361d tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde" status: 200 len: 1246 microversion: 2.1 time: 0.156424 Sep 12 23:55:41.073490 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 127/259] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:40 2022] GET /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde => generated 1246 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:41.224442 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a1f0c8f4-a456-425d-b570-4c908d091854 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:41.242588 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a1f0c8f4-a456-425d-b570-4c908d091854 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:41.253025 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d5d35d72-7470-4fff-8f1d-1b49473891b8 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:41.253634 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d5d35d72-7470-4fff-8f1d-1b49473891b8 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] [instance: c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:41.258511 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a1f0c8f4-a456-425d-b570-4c908d091854 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:41.263677 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a1f0c8f4-a456-425d-b570-4c908d091854 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1741 microversion: 2.20 time: 0.301986 Sep 12 23:55:41.264685 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d5d35d72-7470-4fff-8f1d-1b49473891b8 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:41.265390 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 133/260] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:55:40 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1741 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:55:41.265874 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d5d35d72-7470-4fff-8f1d-1b49473891b8 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:41.266347 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d5d35d72-7470-4fff-8f1d-1b49473891b8 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:41.267136 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d5d35d72-7470-4fff-8f1d-1b49473891b8 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:41.267704 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d5d35d72-7470-4fff-8f1d-1b49473891b8 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:41.268123 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d5d35d72-7470-4fff-8f1d-1b49473891b8 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:41.329952 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-f5f07dbf-9264-417a-8df0-fdeb66c9f1db req-7d4ff16f-04a1-4608-a452-eb0ade45fb03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "893ed869-802c-4a92-b7ab-d2aa8324fb65", "name": "network-vif-plugged", "status": "completed", "tag": "3a5cf7e7-3d44-4786-8d75-99e5d72ef0e0"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:55:41.340150 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-f5f07dbf-9264-417a-8df0-fdeb66c9f1db req-7d4ff16f-04a1-4608-a452-eb0ade45fb03 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:41.340966 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-f5f07dbf-9264-417a-8df0-fdeb66c9f1db req-7d4ff16f-04a1-4608-a452-eb0ade45fb03 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:41.341594 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-f5f07dbf-9264-417a-8df0-fdeb66c9f1db req-7d4ff16f-04a1-4608-a452-eb0ade45fb03 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:41.377854 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-f5f07dbf-9264-417a-8df0-fdeb66c9f1db req-7d4ff16f-04a1-4608-a452-eb0ade45fb03 service nova] Creating event network-vif-plugged:3a5cf7e7-3d44-4786-8d75-99e5d72ef0e0 for instance 893ed869-802c-4a92-b7ab-d2aa8324fb65 on hv-cinder-82002 Sep 12 23:55:41.386245 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-f5f07dbf-9264-417a-8df0-fdeb66c9f1db req-7d4ff16f-04a1-4608-a452-eb0ade45fb03 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059892 Sep 12 23:55:41.387436 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 134/261] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:55:41.449877 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d5d35d72-7470-4fff-8f1d-1b49473891b8 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76b3353ce4b4361872ed6dba9f895d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f7d1c88224ebd85d15f7c43e7fe72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:41.474276 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d5d35d72-7470-4fff-8f1d-1b49473891b8 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a" status: 200 len: 1359 microversion: 2.1 time: 0.222572 Sep 12 23:55:41.474919 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 128/262] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:41 2022] GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a => generated 1359 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:41.630808 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-95f963d3-32e0-45a7-a95a-88871d410227 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:41.632139 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-95f963d3-32e0-45a7-a95a-88871d410227 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:41.639618 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-95f963d3-32e0-45a7-a95a-88871d410227 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:41.640513 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-95f963d3-32e0-45a7-a95a-88871d410227 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:41.641168 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-95f963d3-32e0-45a7-a95a-88871d410227 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:41.642350 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-95f963d3-32e0-45a7-a95a-88871d410227 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:41.643065 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-95f963d3-32e0-45a7-a95a-88871d410227 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:41.643877 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-95f963d3-32e0-45a7-a95a-88871d410227 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:41.854632 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-95f963d3-32e0-45a7-a95a-88871d410227 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:41.864468 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-95f963d3-32e0-45a7-a95a-88871d410227 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c" status: 200 len: 1361 microversion: 2.1 time: 0.237881 Sep 12 23:55:41.871306 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 135/263] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:41 2022] GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c => generated 1361 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:41.975158 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2a68a61b-74e2-4d3d-a66a-03efbf490103 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:41.975802 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2a68a61b-74e2-4d3d-a66a-03efbf490103 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 695586a7-2b4d-477b-ab83-9e74f5f7078a] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:41.983424 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2a68a61b-74e2-4d3d-a66a-03efbf490103 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:41.985237 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2a68a61b-74e2-4d3d-a66a-03efbf490103 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:41.985742 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2a68a61b-74e2-4d3d-a66a-03efbf490103 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:41.986493 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2a68a61b-74e2-4d3d-a66a-03efbf490103 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:41.986950 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2a68a61b-74e2-4d3d-a66a-03efbf490103 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:41.987400 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2a68a61b-74e2-4d3d-a66a-03efbf490103 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:42.098493 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c2ba2cca-274a-4beb-972b-2f4fce76ceb5 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:42.099739 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c2ba2cca-274a-4beb-972b-2f4fce76ceb5 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: ad5faa90-b5ff-47e2-abab-21418459ecde] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:42.108982 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c2ba2cca-274a-4beb-972b-2f4fce76ceb5 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:42.109906 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c2ba2cca-274a-4beb-972b-2f4fce76ceb5 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:42.111266 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c2ba2cca-274a-4beb-972b-2f4fce76ceb5 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:42.112368 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c2ba2cca-274a-4beb-972b-2f4fce76ceb5 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:42.113171 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c2ba2cca-274a-4beb-972b-2f4fce76ceb5 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:42.113833 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c2ba2cca-274a-4beb-972b-2f4fce76ceb5 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:42.188422 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2a68a61b-74e2-4d3d-a66a-03efbf490103 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:42.208989 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2a68a61b-74e2-4d3d-a66a-03efbf490103 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a" status: 200 len: 1511 microversion: 2.1 time: 0.237586 Sep 12 23:55:42.217543 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 129/264] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:41 2022] GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a => generated 1511 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:42.231538 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c2ba2cca-274a-4beb-972b-2f4fce76ceb5 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:42.241584 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c2ba2cca-274a-4beb-972b-2f4fce76ceb5 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde" status: 200 len: 1246 microversion: 2.1 time: 0.149276 Sep 12 23:55:42.243201 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 136/265] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:42 2022] GET /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde => generated 1246 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:55:42.296145 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-20707f75-370e-4b3b-82b6-52a6901811bb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:42.296956 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-20707f75-370e-4b3b-82b6-52a6901811bb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:42.312776 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-20707f75-370e-4b3b-82b6-52a6901811bb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:42.313233 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-20707f75-370e-4b3b-82b6-52a6901811bb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:42.313987 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-20707f75-370e-4b3b-82b6-52a6901811bb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:42.314533 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-20707f75-370e-4b3b-82b6-52a6901811bb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:42.315199 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-20707f75-370e-4b3b-82b6-52a6901811bb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:42.315797 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-20707f75-370e-4b3b-82b6-52a6901811bb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:42.499634 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c3aaeeb2-882b-49c2-bc41-5525a720a3b0 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:42.500266 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c3aaeeb2-882b-49c2-bc41-5525a720a3b0 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] [instance: c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:42.506939 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c3aaeeb2-882b-49c2-bc41-5525a720a3b0 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:42.507490 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c3aaeeb2-882b-49c2-bc41-5525a720a3b0 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:42.507908 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c3aaeeb2-882b-49c2-bc41-5525a720a3b0 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:42.508688 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c3aaeeb2-882b-49c2-bc41-5525a720a3b0 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:42.509151 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c3aaeeb2-882b-49c2-bc41-5525a720a3b0 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:42.509646 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c3aaeeb2-882b-49c2-bc41-5525a720a3b0 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:42.530922 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-20707f75-370e-4b3b-82b6-52a6901811bb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:42.541915 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-20707f75-370e-4b3b-82b6-52a6901811bb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:42.544599 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-20707f75-370e-4b3b-82b6-52a6901811bb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:42.545178 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-20707f75-370e-4b3b-82b6-52a6901811bb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1741 microversion: 2.20 time: 0.253540 Sep 12 23:55:42.557890 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 130/266] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:55:42 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1741 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 23:55:42.689727 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c3aaeeb2-882b-49c2-bc41-5525a720a3b0 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76b3353ce4b4361872ed6dba9f895d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f7d1c88224ebd85d15f7c43e7fe72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:42.699424 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c3aaeeb2-882b-49c2-bc41-5525a720a3b0 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a" status: 200 len: 1359 microversion: 2.1 time: 0.204082 Sep 12 23:55:42.700029 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 137/267] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:42 2022] GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a => generated 1359 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:42.909506 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f67b9037-604f-4004-8d3d-dcc2cef5d1e4 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:42.910165 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f67b9037-604f-4004-8d3d-dcc2cef5d1e4 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:42.916707 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f67b9037-604f-4004-8d3d-dcc2cef5d1e4 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:42.917206 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f67b9037-604f-4004-8d3d-dcc2cef5d1e4 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:42.917650 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f67b9037-604f-4004-8d3d-dcc2cef5d1e4 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:42.918477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f67b9037-604f-4004-8d3d-dcc2cef5d1e4 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:42.918928 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f67b9037-604f-4004-8d3d-dcc2cef5d1e4 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:42.919491 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f67b9037-604f-4004-8d3d-dcc2cef5d1e4 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:43.066827 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f67b9037-604f-4004-8d3d-dcc2cef5d1e4 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:43.080417 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f67b9037-604f-4004-8d3d-dcc2cef5d1e4 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c" status: 200 len: 1361 microversion: 2.1 time: 0.174514 Sep 12 23:55:43.081710 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 131/268] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:42 2022] GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c => generated 1361 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:43.241967 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b922cdaf-b08a-4bdf-bab1-9dd3c4fd9326 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:43.242938 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b922cdaf-b08a-4bdf-bab1-9dd3c4fd9326 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 695586a7-2b4d-477b-ab83-9e74f5f7078a] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:43.252363 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b922cdaf-b08a-4bdf-bab1-9dd3c4fd9326 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:43.253000 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b922cdaf-b08a-4bdf-bab1-9dd3c4fd9326 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:43.253610 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b922cdaf-b08a-4bdf-bab1-9dd3c4fd9326 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:43.254705 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b922cdaf-b08a-4bdf-bab1-9dd3c4fd9326 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:43.255462 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b922cdaf-b08a-4bdf-bab1-9dd3c4fd9326 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:43.256075 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b922cdaf-b08a-4bdf-bab1-9dd3c4fd9326 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:43.268564 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-935aac31-69a9-4c29-a5e0-e86fe98daa17 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:43.269552 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-935aac31-69a9-4c29-a5e0-e86fe98daa17 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: ad5faa90-b5ff-47e2-abab-21418459ecde] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:43.289460 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-935aac31-69a9-4c29-a5e0-e86fe98daa17 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:43.292686 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-935aac31-69a9-4c29-a5e0-e86fe98daa17 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:43.293550 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-935aac31-69a9-4c29-a5e0-e86fe98daa17 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:43.294525 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-935aac31-69a9-4c29-a5e0-e86fe98daa17 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:43.295337 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-935aac31-69a9-4c29-a5e0-e86fe98daa17 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:43.296105 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-935aac31-69a9-4c29-a5e0-e86fe98daa17 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:43.414815 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-935aac31-69a9-4c29-a5e0-e86fe98daa17 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:43.438993 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-935aac31-69a9-4c29-a5e0-e86fe98daa17 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde" status: 200 len: 1246 microversion: 2.1 time: 0.176241 Sep 12 23:55:43.441664 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 132/269] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:43 2022] GET /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde => generated 1246 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:55:43.453195 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-5c495578-b6ec-4ea8-b279-3ebe81ecb899 req-c820550f-b218-4777-9f7a-cf800616d6bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df2886ea-3e42-4713-82e6-bacd4de26d8c", "name": "network-vif-plugged", "status": "completed", "tag": "c4502ec9-84fa-4339-b714-5cfae4677e4e"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:55:43.473448 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-5c495578-b6ec-4ea8-b279-3ebe81ecb899 req-c820550f-b218-4777-9f7a-cf800616d6bd service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:43.474284 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-5c495578-b6ec-4ea8-b279-3ebe81ecb899 req-c820550f-b218-4777-9f7a-cf800616d6bd service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:43.475211 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-5c495578-b6ec-4ea8-b279-3ebe81ecb899 req-c820550f-b218-4777-9f7a-cf800616d6bd service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:43.515967 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-5c495578-b6ec-4ea8-b279-3ebe81ecb899 req-c820550f-b218-4777-9f7a-cf800616d6bd service nova] Creating event network-vif-plugged:c4502ec9-84fa-4339-b714-5cfae4677e4e for instance df2886ea-3e42-4713-82e6-bacd4de26d8c on hv-cinder-82002 Sep 12 23:55:43.528262 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-5c495578-b6ec-4ea8-b279-3ebe81ecb899 req-c820550f-b218-4777-9f7a-cf800616d6bd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083632 Sep 12 23:55:43.530487 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 133/270] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:55:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:55:43.570109 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b922cdaf-b08a-4bdf-bab1-9dd3c4fd9326 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:43.585012 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-da82943b-b02f-45e8-bb9c-d4205c75c0ca tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:43.585866 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b922cdaf-b08a-4bdf-bab1-9dd3c4fd9326 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a" status: 200 len: 1511 microversion: 2.1 time: 0.347819 Sep 12 23:55:43.585992 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-da82943b-b02f-45e8-bb9c-d4205c75c0ca tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:43.588079 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 138/271] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:43 2022] GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a => generated 1511 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:43.615352 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-da82943b-b02f-45e8-bb9c-d4205c75c0ca tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:43.616152 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-da82943b-b02f-45e8-bb9c-d4205c75c0ca tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:43.616910 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-da82943b-b02f-45e8-bb9c-d4205c75c0ca tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:43.618157 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-da82943b-b02f-45e8-bb9c-d4205c75c0ca tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:43.618786 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-da82943b-b02f-45e8-bb9c-d4205c75c0ca tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:43.619604 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-da82943b-b02f-45e8-bb9c-d4205c75c0ca tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:43.722344 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a61a8b38-83e9-4ab3-be53-20113f2544cf tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:43.722906 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a61a8b38-83e9-4ab3-be53-20113f2544cf tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] [instance: c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:43.734348 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a61a8b38-83e9-4ab3-be53-20113f2544cf tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:43.734834 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a61a8b38-83e9-4ab3-be53-20113f2544cf tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:43.735333 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a61a8b38-83e9-4ab3-be53-20113f2544cf tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:43.736056 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a61a8b38-83e9-4ab3-be53-20113f2544cf tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:43.736507 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a61a8b38-83e9-4ab3-be53-20113f2544cf tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:43.736923 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a61a8b38-83e9-4ab3-be53-20113f2544cf tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:43.965235 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-da82943b-b02f-45e8-bb9c-d4205c75c0ca tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:43.993225 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-da82943b-b02f-45e8-bb9c-d4205c75c0ca tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:44.013851 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-da82943b-b02f-45e8-bb9c-d4205c75c0ca tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:44.013851 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-da82943b-b02f-45e8-bb9c-d4205c75c0ca tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1741 microversion: 2.20 time: 0.417945 Sep 12 23:55:44.060508 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 134/272] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:55:43 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1741 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:55:44.106174 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a5f1ab87-49f1-439f-976a-55bb3143b3c9 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:44.106174 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a5f1ab87-49f1-439f-976a-55bb3143b3c9 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:44.129724 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a5f1ab87-49f1-439f-976a-55bb3143b3c9 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:44.130054 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a5f1ab87-49f1-439f-976a-55bb3143b3c9 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:44.135987 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a5f1ab87-49f1-439f-976a-55bb3143b3c9 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:44.135987 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a5f1ab87-49f1-439f-976a-55bb3143b3c9 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:44.135987 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a5f1ab87-49f1-439f-976a-55bb3143b3c9 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:44.135987 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a5f1ab87-49f1-439f-976a-55bb3143b3c9 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:44.327490 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a61a8b38-83e9-4ab3-be53-20113f2544cf tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76b3353ce4b4361872ed6dba9f895d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f7d1c88224ebd85d15f7c43e7fe72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:44.339381 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a61a8b38-83e9-4ab3-be53-20113f2544cf tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a" status: 200 len: 1359 microversion: 2.1 time: 0.620980 Sep 12 23:55:44.343546 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 139/273] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:43 2022] GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a => generated 1359 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:55:44.463659 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8586dc22-cd60-4d80-b114-6d62ef8dd471 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:44.464708 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8586dc22-cd60-4d80-b114-6d62ef8dd471 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: ad5faa90-b5ff-47e2-abab-21418459ecde] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:44.482504 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8586dc22-cd60-4d80-b114-6d62ef8dd471 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:44.483809 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8586dc22-cd60-4d80-b114-6d62ef8dd471 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:44.484521 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8586dc22-cd60-4d80-b114-6d62ef8dd471 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:44.485544 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8586dc22-cd60-4d80-b114-6d62ef8dd471 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:44.486214 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8586dc22-cd60-4d80-b114-6d62ef8dd471 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:44.487070 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8586dc22-cd60-4d80-b114-6d62ef8dd471 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:44.643668 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8586dc22-cd60-4d80-b114-6d62ef8dd471 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:44.653395 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8586dc22-cd60-4d80-b114-6d62ef8dd471 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde" status: 200 len: 1294 microversion: 2.1 time: 0.194803 Sep 12 23:55:44.667984 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 140/274] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:44 2022] GET /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde => generated 1294 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:55:44.676179 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b26bd37e-c651-420c-a718-a60487bf8c6f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:44.677187 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b26bd37e-c651-420c-a718-a60487bf8c6f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 695586a7-2b4d-477b-ab83-9e74f5f7078a] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:44.685447 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b26bd37e-c651-420c-a718-a60487bf8c6f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:44.686242 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b26bd37e-c651-420c-a718-a60487bf8c6f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:44.686891 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b26bd37e-c651-420c-a718-a60487bf8c6f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:44.687882 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b26bd37e-c651-420c-a718-a60487bf8c6f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:44.688883 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b26bd37e-c651-420c-a718-a60487bf8c6f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:44.689578 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b26bd37e-c651-420c-a718-a60487bf8c6f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:44.721523 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a5f1ab87-49f1-439f-976a-55bb3143b3c9 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:44.741493 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a5f1ab87-49f1-439f-976a-55bb3143b3c9 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c" status: 200 len: 1361 microversion: 2.1 time: 0.641001 Sep 12 23:55:44.742721 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 135/275] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:44 2022] GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c => generated 1361 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:55:44.987295 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b26bd37e-c651-420c-a718-a60487bf8c6f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:45.011214 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b26bd37e-c651-420c-a718-a60487bf8c6f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a" status: 200 len: 1517 microversion: 2.1 time: 0.341782 Sep 12 23:55:45.012582 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 141/276] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:44 2022] GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a => generated 1517 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:45.068731 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5ff11dbf-c958-46c9-96e3-0df204170e0e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:45.072983 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5ff11dbf-c958-46c9-96e3-0df204170e0e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:45.099712 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5ff11dbf-c958-46c9-96e3-0df204170e0e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:45.108794 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5ff11dbf-c958-46c9-96e3-0df204170e0e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:45.109577 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5ff11dbf-c958-46c9-96e3-0df204170e0e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:45.110993 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5ff11dbf-c958-46c9-96e3-0df204170e0e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:45.115797 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5ff11dbf-c958-46c9-96e3-0df204170e0e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:45.119452 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5ff11dbf-c958-46c9-96e3-0df204170e0e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:45.370485 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4699648d-8e79-4128-ab4a-f54d63ade647 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:45.373899 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4699648d-8e79-4128-ab4a-f54d63ade647 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] [instance: c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:45.389979 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4699648d-8e79-4128-ab4a-f54d63ade647 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:45.392472 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4699648d-8e79-4128-ab4a-f54d63ade647 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:45.395524 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4699648d-8e79-4128-ab4a-f54d63ade647 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:45.397196 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4699648d-8e79-4128-ab4a-f54d63ade647 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:45.399957 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4699648d-8e79-4128-ab4a-f54d63ade647 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:45.400766 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4699648d-8e79-4128-ab4a-f54d63ade647 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:45.434442 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-5ff11dbf-c958-46c9-96e3-0df204170e0e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:45.448598 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-5ff11dbf-c958-46c9-96e3-0df204170e0e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:45.450752 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-5ff11dbf-c958-46c9-96e3-0df204170e0e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:45.452475 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5ff11dbf-c958-46c9-96e3-0df204170e0e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1741 microversion: 2.20 time: 0.392287 Sep 12 23:55:45.456020 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 136/277] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:55:45 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1741 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:55:45.695156 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-28600f63-6628-4adc-88b4-3a6fcdb43e1f tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:45.697063 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-28600f63-6628-4adc-88b4-3a6fcdb43e1f tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: ad5faa90-b5ff-47e2-abab-21418459ecde] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:45.703448 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4699648d-8e79-4128-ab4a-f54d63ade647 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76b3353ce4b4361872ed6dba9f895d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f7d1c88224ebd85d15f7c43e7fe72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:45.715208 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-28600f63-6628-4adc-88b4-3a6fcdb43e1f tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:45.716889 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-28600f63-6628-4adc-88b4-3a6fcdb43e1f tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:45.717982 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-28600f63-6628-4adc-88b4-3a6fcdb43e1f tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:45.720130 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-28600f63-6628-4adc-88b4-3a6fcdb43e1f tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:45.721981 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-28600f63-6628-4adc-88b4-3a6fcdb43e1f tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:45.724117 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4699648d-8e79-4128-ab4a-f54d63ade647 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a" status: 200 len: 1359 microversion: 2.1 time: 0.358697 Sep 12 23:55:45.724568 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-28600f63-6628-4adc-88b4-3a6fcdb43e1f tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:45.725576 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 142/278] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:45 2022] GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a => generated 1359 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:45.783999 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3103e299-c74c-40ec-9768-e12982a62837 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:45.785341 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3103e299-c74c-40ec-9768-e12982a62837 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:45.808635 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3103e299-c74c-40ec-9768-e12982a62837 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:45.810922 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3103e299-c74c-40ec-9768-e12982a62837 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:45.811751 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3103e299-c74c-40ec-9768-e12982a62837 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:45.814713 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3103e299-c74c-40ec-9768-e12982a62837 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:45.818910 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3103e299-c74c-40ec-9768-e12982a62837 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:45.819866 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3103e299-c74c-40ec-9768-e12982a62837 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:46.150640 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-28600f63-6628-4adc-88b4-3a6fcdb43e1f tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:46.154325 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3103e299-c74c-40ec-9768-e12982a62837 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:46.161903 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-28600f63-6628-4adc-88b4-3a6fcdb43e1f tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde" status: 200 len: 1294 microversion: 2.1 time: 0.481531 Sep 12 23:55:46.162475 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3103e299-c74c-40ec-9768-e12982a62837 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c" status: 200 len: 1361 microversion: 2.1 time: 0.389421 Sep 12 23:55:46.175547 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 143/279] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:45 2022] GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c => generated 1361 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:55:46.176440 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 137/280] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:45 2022] GET /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde => generated 1294 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:46.481804 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-60f25424-38cd-4918-a087-fabbf24b77af tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:46.482409 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-60f25424-38cd-4918-a087-fabbf24b77af tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:46.489514 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-60f25424-38cd-4918-a087-fabbf24b77af tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:46.490417 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-60f25424-38cd-4918-a087-fabbf24b77af tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:46.490966 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-60f25424-38cd-4918-a087-fabbf24b77af tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:46.491963 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-60f25424-38cd-4918-a087-fabbf24b77af tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:46.492638 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-60f25424-38cd-4918-a087-fabbf24b77af tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:46.493273 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-60f25424-38cd-4918-a087-fabbf24b77af tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:46.742586 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-60f25424-38cd-4918-a087-fabbf24b77af tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:46.750264 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9dbff453-e10e-4834-ae31-94cc05b508da tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:46.750969 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9dbff453-e10e-4834-ae31-94cc05b508da tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] [instance: c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:46.757936 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-60f25424-38cd-4918-a087-fabbf24b77af tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:46.760160 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-60f25424-38cd-4918-a087-fabbf24b77af tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:46.762346 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-60f25424-38cd-4918-a087-fabbf24b77af tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1741 microversion: 2.20 time: 0.284690 Sep 12 23:55:46.763253 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 144/281] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:55:46 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1741 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 23:55:46.775268 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9dbff453-e10e-4834-ae31-94cc05b508da tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:46.775737 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9dbff453-e10e-4834-ae31-94cc05b508da tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:46.778018 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9dbff453-e10e-4834-ae31-94cc05b508da tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:46.778957 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9dbff453-e10e-4834-ae31-94cc05b508da tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:46.779613 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9dbff453-e10e-4834-ae31-94cc05b508da tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:46.780227 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9dbff453-e10e-4834-ae31-94cc05b508da tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:46.782766 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1daf8ee0-a9c9-435d-8453-a1d1c9dd77d0 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Action: 'create', calling method: .version_select at 0x7fed01695ca0>, body: {"keypair": {"name": "tempest-keypair-406694843", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDUfoutpYDDjOqy7WfWcWqXDUMN1KHvqITsxjphOwDEXK8iBZo9RToRT4emzzJfKRJQHB9uP5lD7JoAnAfeKvSoagWhcPhCL/r68q3GILqv2zjX6BAFPOGtKFLdic3Ppg=="}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:55:46.826074 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-1daf8ee0-a9c9-435d-8453-a1d1c9dd77d0 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Getting quotas for project 6c458cf41ded4113a09fb07e10d81d39. Resources: {'key_pairs'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 23:55:46.831881 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-1daf8ee0-a9c9-435d-8453-a1d1c9dd77d0 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Getting quotas for user 76eb39c2010e43aaa0a01caaea3a38b9 and project 6c458cf41ded4113a09fb07e10d81d39. Resources: {'key_pairs'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 23:55:46.863319 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1daf8ee0-a9c9-435d-8453-a1d1c9dd77d0 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.090712 Sep 12 23:55:46.866193 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 145/282] 10.222.0.26 () {60 vars in 1159 bytes} [Mon Sep 12 23:55:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:55:47.020148 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-9dbff453-e10e-4834-ae31-94cc05b508da tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76b3353ce4b4361872ed6dba9f895d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f7d1c88224ebd85d15f7c43e7fe72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:47.034996 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9dbff453-e10e-4834-ae31-94cc05b508da tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a" status: 200 len: 1359 microversion: 2.1 time: 0.288579 Sep 12 23:55:47.051015 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 138/283] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:46 2022] GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a => generated 1359 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:47.198218 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4c3a58e8-88d3-4906-a099-746ddf21d607 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:47.198218 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4c3a58e8-88d3-4906-a099-746ddf21d607 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: ad5faa90-b5ff-47e2-abab-21418459ecde] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:47.206192 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3ed86299-f889-4286-ae8d-c2ff4bafd696 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:47.208522 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3ed86299-f889-4286-ae8d-c2ff4bafd696 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:47.210997 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4c3a58e8-88d3-4906-a099-746ddf21d607 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:47.212783 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4c3a58e8-88d3-4906-a099-746ddf21d607 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:47.213976 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4c3a58e8-88d3-4906-a099-746ddf21d607 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:47.214832 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4c3a58e8-88d3-4906-a099-746ddf21d607 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:47.216156 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4c3a58e8-88d3-4906-a099-746ddf21d607 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:47.216618 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4c3a58e8-88d3-4906-a099-746ddf21d607 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:47.224640 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3ed86299-f889-4286-ae8d-c2ff4bafd696 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:47.225575 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3ed86299-f889-4286-ae8d-c2ff4bafd696 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:47.226349 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3ed86299-f889-4286-ae8d-c2ff4bafd696 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:47.227352 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3ed86299-f889-4286-ae8d-c2ff4bafd696 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:47.228217 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3ed86299-f889-4286-ae8d-c2ff4bafd696 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:47.229180 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3ed86299-f889-4286-ae8d-c2ff4bafd696 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:47.350417 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4c3a58e8-88d3-4906-a099-746ddf21d607 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:47.384721 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4c3a58e8-88d3-4906-a099-746ddf21d607 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde" status: 200 len: 1302 microversion: 2.1 time: 0.200349 Sep 12 23:55:47.394445 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 146/284] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:47 2022] GET /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde => generated 1302 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:47.504365 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell0:SELECT=2 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:55:47.563809 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell0:SELECT=10 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:55:47.732526 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3ed86299-f889-4286-ae8d-c2ff4bafd696 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:47.769853 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3ed86299-f889-4286-ae8d-c2ff4bafd696 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c" status: 200 len: 1547 microversion: 2.1 time: 0.578301 Sep 12 23:55:47.790239 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 139/285] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:47 2022] GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c => generated 1547 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:47.818049 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6b519446-86ff-4011-9da3-9c927ba7b9d1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:47.818716 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6b519446-86ff-4011-9da3-9c927ba7b9d1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:47.820091 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a9236894-17e5-4662-a880-3e068620426a tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:47.827664 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a9236894-17e5-4662-a880-3e068620426a tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:47.835953 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6b519446-86ff-4011-9da3-9c927ba7b9d1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:47.836653 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6b519446-86ff-4011-9da3-9c927ba7b9d1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:47.837281 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6b519446-86ff-4011-9da3-9c927ba7b9d1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:47.840316 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6b519446-86ff-4011-9da3-9c927ba7b9d1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:47.841173 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6b519446-86ff-4011-9da3-9c927ba7b9d1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:47.849388 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6b519446-86ff-4011-9da3-9c927ba7b9d1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:47.866099 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a9236894-17e5-4662-a880-3e068620426a tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:47.872078 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a9236894-17e5-4662-a880-3e068620426a tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:47.877281 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a9236894-17e5-4662-a880-3e068620426a tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:47.879305 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a9236894-17e5-4662-a880-3e068620426a tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:47.880339 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a9236894-17e5-4662-a880-3e068620426a tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:47.881426 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a9236894-17e5-4662-a880-3e068620426a tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:48.517489 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a9236894-17e5-4662-a880-3e068620426a tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.717584 Sep 12 23:55:48.518662 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 147/286] 10.222.0.26 () {58 vars in 1275 bytes} [Mon Sep 12 23:55:47 2022] GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c/os-interface => generated 284 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:55:48.531919 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-cdb54b3e-a80a-4a6b-a6a4-48316f934e2d tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:48.533004 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-cdb54b3e-a80a-4a6b-a6a4-48316f934e2d tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] [instance: c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:48.540941 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cdb54b3e-a80a-4a6b-a6a4-48316f934e2d tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:48.541673 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cdb54b3e-a80a-4a6b-a6a4-48316f934e2d tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:48.542247 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cdb54b3e-a80a-4a6b-a6a4-48316f934e2d tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:48.543119 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cdb54b3e-a80a-4a6b-a6a4-48316f934e2d tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:48.543881 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cdb54b3e-a80a-4a6b-a6a4-48316f934e2d tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:48.544448 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cdb54b3e-a80a-4a6b-a6a4-48316f934e2d tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:48.568195 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=100 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:55:48.728511 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6b519446-86ff-4011-9da3-9c927ba7b9d1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:48.748721 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6b519446-86ff-4011-9da3-9c927ba7b9d1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:48.752067 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6b519446-86ff-4011-9da3-9c927ba7b9d1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:48.754999 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6b519446-86ff-4011-9da3-9c927ba7b9d1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1741 microversion: 2.20 time: 0.949989 Sep 12 23:55:48.756227 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 140/287] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:55:47 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1741 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 23:55:48.765146 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-03ed19ed-9bd1-4d9d-a2d6-a419c3715dec tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:48.767338 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-03ed19ed-9bd1-4d9d-a2d6-a419c3715dec tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: ad5faa90-b5ff-47e2-abab-21418459ecde] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:48.778176 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-03ed19ed-9bd1-4d9d-a2d6-a419c3715dec tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:48.779642 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-03ed19ed-9bd1-4d9d-a2d6-a419c3715dec tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:48.780628 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-03ed19ed-9bd1-4d9d-a2d6-a419c3715dec tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:48.783108 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-03ed19ed-9bd1-4d9d-a2d6-a419c3715dec tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:48.784041 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-03ed19ed-9bd1-4d9d-a2d6-a419c3715dec tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:48.785031 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-03ed19ed-9bd1-4d9d-a2d6-a419c3715dec tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:48.917648 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-03ed19ed-9bd1-4d9d-a2d6-a419c3715dec tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:48.936304 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-03ed19ed-9bd1-4d9d-a2d6-a419c3715dec tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde" status: 200 len: 1300 microversion: 2.1 time: 0.178567 Sep 12 23:55:48.937893 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 141/288] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:48 2022] GET /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde => generated 1300 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:48.999405 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-cdb54b3e-a80a-4a6b-a6a4-48316f934e2d tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76b3353ce4b4361872ed6dba9f895d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f7d1c88224ebd85d15f7c43e7fe72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:49.008637 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-cdb54b3e-a80a-4a6b-a6a4-48316f934e2d tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a" status: 200 len: 1359 microversion: 2.1 time: 0.488616 Sep 12 23:55:49.013127 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 148/289] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:48 2022] GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a => generated 1359 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:49.788638 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-80c61e56-34a3-4b23-b07a-2ae6cd492890 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:49.790298 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-80c61e56-34a3-4b23-b07a-2ae6cd492890 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:49.807204 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-80c61e56-34a3-4b23-b07a-2ae6cd492890 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:49.807881 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-80c61e56-34a3-4b23-b07a-2ae6cd492890 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:49.808328 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-80c61e56-34a3-4b23-b07a-2ae6cd492890 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:49.809087 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-80c61e56-34a3-4b23-b07a-2ae6cd492890 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:49.811329 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-80c61e56-34a3-4b23-b07a-2ae6cd492890 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:49.811329 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-80c61e56-34a3-4b23-b07a-2ae6cd492890 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:49.831618 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:55:49.963680 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4f759d90-987c-4d8c-b9ee-d327c8500aa0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:49.966752 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4f759d90-987c-4d8c-b9ee-d327c8500aa0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: ad5faa90-b5ff-47e2-abab-21418459ecde] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:49.992762 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:55:50.002177 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4f759d90-987c-4d8c-b9ee-d327c8500aa0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:50.005536 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4f759d90-987c-4d8c-b9ee-d327c8500aa0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:50.006993 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4f759d90-987c-4d8c-b9ee-d327c8500aa0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:50.011789 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4f759d90-987c-4d8c-b9ee-d327c8500aa0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:50.021773 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4f759d90-987c-4d8c-b9ee-d327c8500aa0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:50.022590 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4f759d90-987c-4d8c-b9ee-d327c8500aa0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:50.179525 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-80c61e56-34a3-4b23-b07a-2ae6cd492890 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:50.192754 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-80c61e56-34a3-4b23-b07a-2ae6cd492890 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:50.196382 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-80c61e56-34a3-4b23-b07a-2ae6cd492890 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:50.201294 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-80c61e56-34a3-4b23-b07a-2ae6cd492890 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1741 microversion: 2.20 time: 0.421920 Sep 12 23:55:50.202671 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 142/290] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:55:49 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1741 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:55:50.208520 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-410aa7a7-fd0b-4354-9492-42c8792f9abc tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:50.209596 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-410aa7a7-fd0b-4354-9492-42c8792f9abc tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] [instance: c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:50.217163 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-410aa7a7-fd0b-4354-9492-42c8792f9abc tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:50.217939 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-410aa7a7-fd0b-4354-9492-42c8792f9abc tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:50.218529 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-410aa7a7-fd0b-4354-9492-42c8792f9abc tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:50.219659 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-410aa7a7-fd0b-4354-9492-42c8792f9abc tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:50.220264 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-410aa7a7-fd0b-4354-9492-42c8792f9abc tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:50.220825 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-410aa7a7-fd0b-4354-9492-42c8792f9abc tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:50.536140 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4f759d90-987c-4d8c-b9ee-d327c8500aa0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:50.552512 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4f759d90-987c-4d8c-b9ee-d327c8500aa0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde" status: 200 len: 1367 microversion: 2.1 time: 0.593041 Sep 12 23:55:50.555547 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 149/291] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:49 2022] GET /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde => generated 1367 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:50.566408 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-410aa7a7-fd0b-4354-9492-42c8792f9abc tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76b3353ce4b4361872ed6dba9f895d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f7d1c88224ebd85d15f7c43e7fe72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:50.568371 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7213d6bd-7610-44c9-bca3-45e883001059 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1774781732", "imageRef": "22a47167-5e04-441a-a504-d76d82afc776", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d12b1ca0-0f82-443c-a352-272c3b2c327e"}], "security_groups": [{"name": "tempest-securitygroup--1236429399"}], "key_name": "tempest-keypair-406694843", "user_data": "}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:55:50.577383 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-410aa7a7-fd0b-4354-9492-42c8792f9abc tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a" status: 200 len: 1359 microversion: 2.1 time: 0.373176 Sep 12 23:55:50.579709 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 143/292] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:50 2022] GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a => generated 1359 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:50.589061 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-0c7fbf21-5b7a-4018-b20e-25d0787304e3 req-25a7380c-15ed-4fab-9ad5-4edb563b6567 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df2886ea-3e42-4713-82e6-bacd4de26d8c", "tag": "c4502ec9-84fa-4339-b714-5cfae4677e4e"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:55:50.603447 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:55:50.609898 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-0c7fbf21-5b7a-4018-b20e-25d0787304e3 req-25a7380c-15ed-4fab-9ad5-4edb563b6567 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:50.610565 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-0c7fbf21-5b7a-4018-b20e-25d0787304e3 req-25a7380c-15ed-4fab-9ad5-4edb563b6567 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:50.610820 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-0c7fbf21-5b7a-4018-b20e-25d0787304e3 req-25a7380c-15ed-4fab-9ad5-4edb563b6567 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:50.640215 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-0c7fbf21-5b7a-4018-b20e-25d0787304e3 req-25a7380c-15ed-4fab-9ad5-4edb563b6567 service nova] Creating event network-changed:c4502ec9-84fa-4339-b714-5cfae4677e4e for instance df2886ea-3e42-4713-82e6-bacd4de26d8c on hv-cinder-82002 Sep 12 23:55:50.651039 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-0c7fbf21-5b7a-4018-b20e-25d0787304e3 req-25a7380c-15ed-4fab-9ad5-4edb563b6567 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070031 Sep 12 23:55:50.660239 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 144/293] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:55:50.851943 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.network.neutron [None req-7213d6bd-7610-44c9-bca3-45e883001059 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] validate_networks() for [('d12b1ca0-0f82-443c-a352-272c3b2c327e', None, None, None, None, None)] {{(pid=126975) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 23:55:51.233870 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b4c6c72d-135c-403c-b3b6-6cd16c950b71 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:51.235384 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b4c6c72d-135c-403c-b3b6-6cd16c950b71 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:51.242104 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b4c6c72d-135c-403c-b3b6-6cd16c950b71 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:51.242979 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b4c6c72d-135c-403c-b3b6-6cd16c950b71 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:51.243666 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b4c6c72d-135c-403c-b3b6-6cd16c950b71 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:51.244604 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b4c6c72d-135c-403c-b3b6-6cd16c950b71 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:51.245267 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b4c6c72d-135c-403c-b3b6-6cd16c950b71 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:51.245913 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b4c6c72d-135c-403c-b3b6-6cd16c950b71 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:51.815264 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b4c6c72d-135c-403c-b3b6-6cd16c950b71 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:51.832101 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b4c6c72d-135c-403c-b3b6-6cd16c950b71 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:51.835156 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b4c6c72d-135c-403c-b3b6-6cd16c950b71 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:51.849130 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b4c6c72d-135c-403c-b3b6-6cd16c950b71 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1741 microversion: 2.20 time: 0.621401 Sep 12 23:55:51.850913 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 145/294] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:55:51 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1741 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 23:55:51.859866 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c73e80e0-0ac6-405e-bef8-f683353fd43d tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:51.861235 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c73e80e0-0ac6-405e-bef8-f683353fd43d tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: ad5faa90-b5ff-47e2-abab-21418459ecde] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:51.870916 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c73e80e0-0ac6-405e-bef8-f683353fd43d tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:51.871593 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c73e80e0-0ac6-405e-bef8-f683353fd43d tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:51.872207 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c73e80e0-0ac6-405e-bef8-f683353fd43d tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:51.873299 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c73e80e0-0ac6-405e-bef8-f683353fd43d tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:51.874084 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c73e80e0-0ac6-405e-bef8-f683353fd43d tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:51.874844 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c73e80e0-0ac6-405e-bef8-f683353fd43d tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:52.253914 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-7213d6bd-7610-44c9-bca3-45e883001059 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Flavor limits 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 23:55:52.257495 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-7213d6bd-7610-44c9-bca3-45e883001059 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Image limits 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 23:55:52.258451 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-7213d6bd-7610-44c9-bca3-45e883001059 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Flavor pref 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 23:55:52.259209 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-7213d6bd-7610-44c9-bca3-45e883001059 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Image pref 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 23:55:52.261705 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-7213d6bd-7610-44c9-bca3-45e883001059 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 23:55:52.288246 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7213d6bd-7610-44c9-bca3-45e883001059 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:52.289372 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7213d6bd-7610-44c9-bca3-45e883001059 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:52.290296 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7213d6bd-7610-44c9-bca3-45e883001059 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:52.292171 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7213d6bd-7610-44c9-bca3-45e883001059 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:52.293544 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7213d6bd-7610-44c9-bca3-45e883001059 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:52.296402 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7213d6bd-7610-44c9-bca3-45e883001059 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:52.336904 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-7213d6bd-7610-44c9-bca3-45e883001059 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Getting quotas for project 6c458cf41ded4113a09fb07e10d81d39. Resources: {'instances', 'cores', 'ram'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 23:55:52.341961 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-7213d6bd-7610-44c9-bca3-45e883001059 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Getting quotas for user 76eb39c2010e43aaa0a01caaea3a38b9 and project 6c458cf41ded4113a09fb07e10d81d39. Resources: {'instances', 'cores', 'ram'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 23:55:52.354588 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7213d6bd-7610-44c9-bca3-45e883001059 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Going to run 1 instances... {{(pid=126975) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 23:55:52.358205 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7213d6bd-7610-44c9-bca3-45e883001059 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 0be21a98-d3f6-4f26-8947-fd39015a7735] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='22a47167-5e04-441a-a504-d76d82afc776',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126975) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 23:55:52.435821 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7213d6bd-7610-44c9-bca3-45e883001059 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.873178 Sep 12 23:55:52.436972 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 150/295] 10.222.0.26 () {60 vars in 1147 bytes} [Mon Sep 12 23:55:50 2022] POST /compute/v2.1/servers => generated 409 bytes in 1880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 12 23:55:52.446623 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4291e1ff-52ac-499d-9238-b48eb5db2eda tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:52.447281 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4291e1ff-52ac-499d-9238-b48eb5db2eda tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] [instance: c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:52.471332 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4291e1ff-52ac-499d-9238-b48eb5db2eda tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:52.471819 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4291e1ff-52ac-499d-9238-b48eb5db2eda tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:52.472244 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4291e1ff-52ac-499d-9238-b48eb5db2eda tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:52.472939 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4291e1ff-52ac-499d-9238-b48eb5db2eda tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:52.473381 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4291e1ff-52ac-499d-9238-b48eb5db2eda tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:52.473794 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4291e1ff-52ac-499d-9238-b48eb5db2eda tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:52.764187 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c73e80e0-0ac6-405e-bef8-f683353fd43d tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:52.814660 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c73e80e0-0ac6-405e-bef8-f683353fd43d tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde" status: 200 len: 1367 microversion: 2.1 time: 0.960942 Sep 12 23:55:52.816068 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 146/296] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:51 2022] GET /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde => generated 1367 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:52.872584 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-d2cd8382-8726-44e6-bd04-f5f56b7f1ee1 req-54533d95-91bb-4b59-8f8c-0908d0ec9833 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad5faa90-b5ff-47e2-abab-21418459ecde", "tag": "81ec905f-b1b8-4515-bb0c-1bc37b74e48f"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:55:52.886044 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-d2cd8382-8726-44e6-bd04-f5f56b7f1ee1 req-54533d95-91bb-4b59-8f8c-0908d0ec9833 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:52.886522 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-d2cd8382-8726-44e6-bd04-f5f56b7f1ee1 req-54533d95-91bb-4b59-8f8c-0908d0ec9833 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:52.886931 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-d2cd8382-8726-44e6-bd04-f5f56b7f1ee1 req-54533d95-91bb-4b59-8f8c-0908d0ec9833 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:52.908737 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-d2cd8382-8726-44e6-bd04-f5f56b7f1ee1 req-54533d95-91bb-4b59-8f8c-0908d0ec9833 service nova] Creating event network-changed:81ec905f-b1b8-4515-bb0c-1bc37b74e48f for instance ad5faa90-b5ff-47e2-abab-21418459ecde on hv-cinder-82002 Sep 12 23:55:52.930535 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-d2cd8382-8726-44e6-bd04-f5f56b7f1ee1 req-54533d95-91bb-4b59-8f8c-0908d0ec9833 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112122 Sep 12 23:55:52.931480 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 147/297] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:55:52.943487 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-332d01fb-5c5f-4df2-9db5-de8e0a7dc866 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:52.945947 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-332d01fb-5c5f-4df2-9db5-de8e0a7dc866 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 0be21a98-d3f6-4f26-8947-fd39015a7735] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:53.084946 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-332d01fb-5c5f-4df2-9db5-de8e0a7dc866 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:53.102185 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-332d01fb-5c5f-4df2-9db5-de8e0a7dc866 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735" status: 200 len: 1245 microversion: 2.1 time: 0.165727 Sep 12 23:55:53.104249 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 148/298] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:52 2022] GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735 => generated 1245 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:53.117337 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-750c9d16-b668-411d-8148-d336c168bc6a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:53.122003 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-750c9d16-b668-411d-8148-d336c168bc6a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:53.130311 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4291e1ff-52ac-499d-9238-b48eb5db2eda tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76b3353ce4b4361872ed6dba9f895d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f7d1c88224ebd85d15f7c43e7fe72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:53.135528 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-750c9d16-b668-411d-8148-d336c168bc6a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:53.138607 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-750c9d16-b668-411d-8148-d336c168bc6a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:53.140622 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-750c9d16-b668-411d-8148-d336c168bc6a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:53.142570 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-750c9d16-b668-411d-8148-d336c168bc6a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:53.143360 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-750c9d16-b668-411d-8148-d336c168bc6a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:53.144491 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-750c9d16-b668-411d-8148-d336c168bc6a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:53.145521 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4291e1ff-52ac-499d-9238-b48eb5db2eda tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a" status: 200 len: 1359 microversion: 2.1 time: 0.707222 Sep 12 23:55:53.147881 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 151/299] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:52 2022] GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a => generated 1359 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:53.262392 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-f70b9a87-a730-4fc2-9dbf-98d99506bd2c req-5a9e4db6-33b8-4e2b-a563-70aad4c1e548 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a", "name": "network-vif-plugged", "status": "completed", "tag": "57c9f24f-46a8-416f-96ec-1d08fd0338ff"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:55:53.288980 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-f70b9a87-a730-4fc2-9dbf-98d99506bd2c req-5a9e4db6-33b8-4e2b-a563-70aad4c1e548 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:53.292559 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-f70b9a87-a730-4fc2-9dbf-98d99506bd2c req-5a9e4db6-33b8-4e2b-a563-70aad4c1e548 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:53.298723 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-f70b9a87-a730-4fc2-9dbf-98d99506bd2c req-5a9e4db6-33b8-4e2b-a563-70aad4c1e548 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:53.326194 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-f70b9a87-a730-4fc2-9dbf-98d99506bd2c req-5a9e4db6-33b8-4e2b-a563-70aad4c1e548 service nova] Creating event network-vif-plugged:57c9f24f-46a8-416f-96ec-1d08fd0338ff for instance c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a on hv-cinder-82002 Sep 12 23:55:53.345255 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-f70b9a87-a730-4fc2-9dbf-98d99506bd2c req-5a9e4db6-33b8-4e2b-a563-70aad4c1e548 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087127 Sep 12 23:55:53.356055 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 152/300] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 23:55:53.592597 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-750c9d16-b668-411d-8148-d336c168bc6a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:53.602008 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-750c9d16-b668-411d-8148-d336c168bc6a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:53.603724 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-750c9d16-b668-411d-8148-d336c168bc6a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:53.605121 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-750c9d16-b668-411d-8148-d336c168bc6a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1741 microversion: 2.20 time: 0.499157 Sep 12 23:55:53.605842 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 149/301] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:55:53 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1741 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:55:53.840501 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4cadec49-06c1-447c-a305-bdd78526f6a7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:53.841139 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4cadec49-06c1-447c-a305-bdd78526f6a7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: ad5faa90-b5ff-47e2-abab-21418459ecde] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:53.848325 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4cadec49-06c1-447c-a305-bdd78526f6a7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:53.848999 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4cadec49-06c1-447c-a305-bdd78526f6a7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:53.849582 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4cadec49-06c1-447c-a305-bdd78526f6a7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:53.850272 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4cadec49-06c1-447c-a305-bdd78526f6a7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:53.850713 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4cadec49-06c1-447c-a305-bdd78526f6a7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:53.851356 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4cadec49-06c1-447c-a305-bdd78526f6a7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:54.010895 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4cadec49-06c1-447c-a305-bdd78526f6a7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:54.023476 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4cadec49-06c1-447c-a305-bdd78526f6a7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde" status: 200 len: 1367 microversion: 2.1 time: 0.188767 Sep 12 23:55:54.051987 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 153/302] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:53 2022] GET /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:54.128839 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2c0d7fd4-425a-4a26-8fe4-3569ebbcd6ab tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:54.129460 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2c0d7fd4-425a-4a26-8fe4-3569ebbcd6ab tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 0be21a98-d3f6-4f26-8947-fd39015a7735] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:54.136239 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2c0d7fd4-425a-4a26-8fe4-3569ebbcd6ab tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:54.137241 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2c0d7fd4-425a-4a26-8fe4-3569ebbcd6ab tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:54.137633 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2c0d7fd4-425a-4a26-8fe4-3569ebbcd6ab tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:54.138384 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2c0d7fd4-425a-4a26-8fe4-3569ebbcd6ab tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:54.138809 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2c0d7fd4-425a-4a26-8fe4-3569ebbcd6ab tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:54.139496 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2c0d7fd4-425a-4a26-8fe4-3569ebbcd6ab tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:54.175253 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ae18423d-53aa-41b2-89df-9f2c6a30a3cf tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:54.176063 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ae18423d-53aa-41b2-89df-9f2c6a30a3cf tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] [instance: c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:54.182445 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ae18423d-53aa-41b2-89df-9f2c6a30a3cf tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:54.182980 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ae18423d-53aa-41b2-89df-9f2c6a30a3cf tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:54.183632 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ae18423d-53aa-41b2-89df-9f2c6a30a3cf tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:54.184591 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ae18423d-53aa-41b2-89df-9f2c6a30a3cf tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:54.185248 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ae18423d-53aa-41b2-89df-9f2c6a30a3cf tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:54.185879 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ae18423d-53aa-41b2-89df-9f2c6a30a3cf tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:54.208118 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2c0d7fd4-425a-4a26-8fe4-3569ebbcd6ab tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:54.222011 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2c0d7fd4-425a-4a26-8fe4-3569ebbcd6ab tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735" status: 200 len: 1297 microversion: 2.1 time: 0.098843 Sep 12 23:55:54.222983 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 150/303] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:54 2022] GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735 => generated 1297 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:54.345330 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ae18423d-53aa-41b2-89df-9f2c6a30a3cf tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76b3353ce4b4361872ed6dba9f895d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f7d1c88224ebd85d15f7c43e7fe72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:54.356939 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ae18423d-53aa-41b2-89df-9f2c6a30a3cf tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a" status: 200 len: 1359 microversion: 2.1 time: 0.185299 Sep 12 23:55:54.357980 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 154/304] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:54 2022] GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:55:54.634638 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6772bc13-dd9e-4bae-a2ed-b30aa27c144e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:54.635448 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6772bc13-dd9e-4bae-a2ed-b30aa27c144e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:54.645363 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6772bc13-dd9e-4bae-a2ed-b30aa27c144e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:54.645867 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6772bc13-dd9e-4bae-a2ed-b30aa27c144e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:54.646295 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6772bc13-dd9e-4bae-a2ed-b30aa27c144e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:54.647051 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6772bc13-dd9e-4bae-a2ed-b30aa27c144e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:54.647523 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6772bc13-dd9e-4bae-a2ed-b30aa27c144e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:54.647994 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6772bc13-dd9e-4bae-a2ed-b30aa27c144e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:54.814340 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6772bc13-dd9e-4bae-a2ed-b30aa27c144e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:54.826652 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6772bc13-dd9e-4bae-a2ed-b30aa27c144e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:54.828102 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6772bc13-dd9e-4bae-a2ed-b30aa27c144e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:54.829376 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6772bc13-dd9e-4bae-a2ed-b30aa27c144e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1741 microversion: 2.20 time: 0.198959 Sep 12 23:55:54.830256 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 151/305] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:55:54 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1741 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:55:55.059089 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c4677dbf-b268-46ae-a2ad-0f1aaa16c79b tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:55.059639 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c4677dbf-b268-46ae-a2ad-0f1aaa16c79b tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: ad5faa90-b5ff-47e2-abab-21418459ecde] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:55.066386 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c4677dbf-b268-46ae-a2ad-0f1aaa16c79b tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:55.067171 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c4677dbf-b268-46ae-a2ad-0f1aaa16c79b tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:55.067632 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c4677dbf-b268-46ae-a2ad-0f1aaa16c79b tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:55.068351 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c4677dbf-b268-46ae-a2ad-0f1aaa16c79b tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:55.068802 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c4677dbf-b268-46ae-a2ad-0f1aaa16c79b tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:55.069221 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c4677dbf-b268-46ae-a2ad-0f1aaa16c79b tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:55.239153 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c4677dbf-b268-46ae-a2ad-0f1aaa16c79b tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:55.245912 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0c3df99d-6b0f-4b68-b8d3-cdf3ee96063e tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:55.246584 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0c3df99d-6b0f-4b68-b8d3-cdf3ee96063e tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 0be21a98-d3f6-4f26-8947-fd39015a7735] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:55.249881 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c4677dbf-b268-46ae-a2ad-0f1aaa16c79b tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde" status: 200 len: 1367 microversion: 2.1 time: 0.199959 Sep 12 23:55:55.263294 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c3df99d-6b0f-4b68-b8d3-cdf3ee96063e tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:55.263294 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c3df99d-6b0f-4b68-b8d3-cdf3ee96063e tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:55.263294 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c3df99d-6b0f-4b68-b8d3-cdf3ee96063e tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:55.263294 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c3df99d-6b0f-4b68-b8d3-cdf3ee96063e tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:55.263880 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c3df99d-6b0f-4b68-b8d3-cdf3ee96063e tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:55.263880 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c3df99d-6b0f-4b68-b8d3-cdf3ee96063e tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:55.265819 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 155/306] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:55 2022] GET /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:55.349377 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0c3df99d-6b0f-4b68-b8d3-cdf3ee96063e tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:55.368516 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0c3df99d-6b0f-4b68-b8d3-cdf3ee96063e tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735" status: 200 len: 1297 microversion: 2.1 time: 0.126513 Sep 12 23:55:55.395189 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 152/307] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:55 2022] GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735 => generated 1297 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:55:55.399140 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3840a224-9774-4568-9326-863b396cac4e tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:55.399836 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3840a224-9774-4568-9326-863b396cac4e tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] [instance: c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:55.407596 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3840a224-9774-4568-9326-863b396cac4e tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:55.408158 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3840a224-9774-4568-9326-863b396cac4e tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:55.410477 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3840a224-9774-4568-9326-863b396cac4e tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:55.410477 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3840a224-9774-4568-9326-863b396cac4e tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:55.410477 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3840a224-9774-4568-9326-863b396cac4e tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:55.410477 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3840a224-9774-4568-9326-863b396cac4e tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:55.599887 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3840a224-9774-4568-9326-863b396cac4e tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76b3353ce4b4361872ed6dba9f895d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f7d1c88224ebd85d15f7c43e7fe72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:55.616272 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3840a224-9774-4568-9326-863b396cac4e tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a" status: 200 len: 1359 microversion: 2.1 time: 0.223535 Sep 12 23:55:55.616611 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 156/308] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:55 2022] GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a => generated 1359 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:55.858016 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5b3ccb52-1240-4040-b427-2416bc5a4179 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:55.858617 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5b3ccb52-1240-4040-b427-2416bc5a4179 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:55.866660 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5b3ccb52-1240-4040-b427-2416bc5a4179 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:55.867151 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5b3ccb52-1240-4040-b427-2416bc5a4179 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:55.867602 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5b3ccb52-1240-4040-b427-2416bc5a4179 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:55.868333 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5b3ccb52-1240-4040-b427-2416bc5a4179 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:55.868864 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5b3ccb52-1240-4040-b427-2416bc5a4179 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:55.869502 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5b3ccb52-1240-4040-b427-2416bc5a4179 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:56.175268 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-5b3ccb52-1240-4040-b427-2416bc5a4179 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:56.185827 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-5b3ccb52-1240-4040-b427-2416bc5a4179 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:56.187288 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-5b3ccb52-1240-4040-b427-2416bc5a4179 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:56.188571 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5b3ccb52-1240-4040-b427-2416bc5a4179 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1741 microversion: 2.20 time: 0.335147 Sep 12 23:55:56.189477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 153/309] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:55:55 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1741 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:55:56.278572 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e835ac27-daa3-49c3-a022-d6a926561307 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:56.279188 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e835ac27-daa3-49c3-a022-d6a926561307 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: ad5faa90-b5ff-47e2-abab-21418459ecde] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:56.286813 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e835ac27-daa3-49c3-a022-d6a926561307 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:56.287351 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e835ac27-daa3-49c3-a022-d6a926561307 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:56.287787 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e835ac27-daa3-49c3-a022-d6a926561307 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:56.288525 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e835ac27-daa3-49c3-a022-d6a926561307 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:56.288985 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e835ac27-daa3-49c3-a022-d6a926561307 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:56.289404 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e835ac27-daa3-49c3-a022-d6a926561307 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:56.398710 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-afbdf40f-8da6-4d23-9502-249acc08b52c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:56.399458 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-afbdf40f-8da6-4d23-9502-249acc08b52c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 0be21a98-d3f6-4f26-8947-fd39015a7735] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:56.407274 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-afbdf40f-8da6-4d23-9502-249acc08b52c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:56.407801 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-afbdf40f-8da6-4d23-9502-249acc08b52c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:56.410988 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-afbdf40f-8da6-4d23-9502-249acc08b52c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:56.411951 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-afbdf40f-8da6-4d23-9502-249acc08b52c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:56.412433 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-afbdf40f-8da6-4d23-9502-249acc08b52c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:56.412857 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-afbdf40f-8da6-4d23-9502-249acc08b52c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:56.663259 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e835ac27-daa3-49c3-a022-d6a926561307 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:56.673356 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e835ac27-daa3-49c3-a022-d6a926561307 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde" status: 200 len: 1367 microversion: 2.1 time: 0.399441 Sep 12 23:55:56.673953 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 157/310] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:56 2022] GET /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde => generated 1367 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:56.701831 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-01e848e8-67fe-4bd9-b989-cf933bf26253 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:56.701831 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-01e848e8-67fe-4bd9-b989-cf933bf26253 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] [instance: c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:56.704865 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-01e848e8-67fe-4bd9-b989-cf933bf26253 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:56.705355 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-01e848e8-67fe-4bd9-b989-cf933bf26253 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:56.706584 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-01e848e8-67fe-4bd9-b989-cf933bf26253 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:56.706745 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-01e848e8-67fe-4bd9-b989-cf933bf26253 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:56.707142 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-01e848e8-67fe-4bd9-b989-cf933bf26253 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:56.707618 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-01e848e8-67fe-4bd9-b989-cf933bf26253 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:56.754565 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-afbdf40f-8da6-4d23-9502-249acc08b52c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:56.770746 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-afbdf40f-8da6-4d23-9502-249acc08b52c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735" status: 200 len: 1305 microversion: 2.1 time: 0.376451 Sep 12 23:55:56.772026 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 154/311] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:56 2022] GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735 => generated 1305 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:55:57.182833 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-01e848e8-67fe-4bd9-b989-cf933bf26253 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76b3353ce4b4361872ed6dba9f895d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f7d1c88224ebd85d15f7c43e7fe72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:57.192947 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-01e848e8-67fe-4bd9-b989-cf933bf26253 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a" status: 200 len: 1550 microversion: 2.1 time: 0.504210 Sep 12 23:55:57.194052 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 158/312] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:56 2022] GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a => generated 1550 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:57.217766 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-bcc5340e-467d-4fa3-8b37-1a1bec99fc35 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:57.219601 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-bcc5340e-467d-4fa3-8b37-1a1bec99fc35 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:57.228713 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bcc5340e-467d-4fa3-8b37-1a1bec99fc35 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:57.238589 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-92d2197a-d334-4625-ac6f-3435eae81ded tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:57.239749 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-92d2197a-d334-4625-ac6f-3435eae81ded tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] [instance: c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:57.245873 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bcc5340e-467d-4fa3-8b37-1a1bec99fc35 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:57.246626 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bcc5340e-467d-4fa3-8b37-1a1bec99fc35 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:57.248234 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bcc5340e-467d-4fa3-8b37-1a1bec99fc35 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:57.249105 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bcc5340e-467d-4fa3-8b37-1a1bec99fc35 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:57.249900 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bcc5340e-467d-4fa3-8b37-1a1bec99fc35 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:57.264944 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-92d2197a-d334-4625-ac6f-3435eae81ded tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:57.266393 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-92d2197a-d334-4625-ac6f-3435eae81ded tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:57.267758 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-92d2197a-d334-4625-ac6f-3435eae81ded tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:57.269599 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-92d2197a-d334-4625-ac6f-3435eae81ded tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:57.270726 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-92d2197a-d334-4625-ac6f-3435eae81ded tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:57.272047 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-92d2197a-d334-4625-ac6f-3435eae81ded tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:57.826106 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-92d2197a-d334-4625-ac6f-3435eae81ded tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76b3353ce4b4361872ed6dba9f895d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f7d1c88224ebd85d15f7c43e7fe72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:57.835826 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-bcc5340e-467d-4fa3-8b37-1a1bec99fc35 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:57.836414 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-92d2197a-d334-4625-ac6f-3435eae81ded tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a" status: 200 len: 1550 microversion: 2.1 time: 0.605409 Sep 12 23:55:57.846443 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 159/313] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:57 2022] GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a => generated 1550 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:57.851967 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d3252cc1-2766-463b-a535-0653fc92478a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:57.852648 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d3252cc1-2766-463b-a535-0653fc92478a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: ad5faa90-b5ff-47e2-abab-21418459ecde] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:57.861705 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d3252cc1-2766-463b-a535-0653fc92478a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:57.862510 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d3252cc1-2766-463b-a535-0653fc92478a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:57.863100 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d3252cc1-2766-463b-a535-0653fc92478a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:57.863931 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-bcc5340e-467d-4fa3-8b37-1a1bec99fc35 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:57.865932 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-bcc5340e-467d-4fa3-8b37-1a1bec99fc35 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:57.868182 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-bcc5340e-467d-4fa3-8b37-1a1bec99fc35 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1741 microversion: 2.20 time: 0.657717 Sep 12 23:55:57.869393 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 155/314] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:55:57 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1741 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:55:57.874686 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-80b70ff6-be78-4900-a6ed-5427e9c8ea99 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:57.875355 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-80b70ff6-be78-4900-a6ed-5427e9c8ea99 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 0be21a98-d3f6-4f26-8947-fd39015a7735] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:57.881837 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-80b70ff6-be78-4900-a6ed-5427e9c8ea99 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:57.882322 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-80b70ff6-be78-4900-a6ed-5427e9c8ea99 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:57.883324 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-80b70ff6-be78-4900-a6ed-5427e9c8ea99 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:57.884283 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-80b70ff6-be78-4900-a6ed-5427e9c8ea99 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:57.885055 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-80b70ff6-be78-4900-a6ed-5427e9c8ea99 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:57.885773 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-80b70ff6-be78-4900-a6ed-5427e9c8ea99 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:57.894148 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d3252cc1-2766-463b-a535-0653fc92478a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:57.894691 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d3252cc1-2766-463b-a535-0653fc92478a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:57.895134 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d3252cc1-2766-463b-a535-0653fc92478a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:58.003740 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-80b70ff6-be78-4900-a6ed-5427e9c8ea99 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:58.017963 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-80b70ff6-be78-4900-a6ed-5427e9c8ea99 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735" status: 200 len: 1303 microversion: 2.1 time: 0.146565 Sep 12 23:55:58.018993 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 156/315] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:57 2022] GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735 => generated 1303 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:58.026940 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0c2685c2-7006-4d8e-a1b8-3aaedf24dd19 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:58.035609 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0c2685c2-7006-4d8e-a1b8-3aaedf24dd19 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e76b3353ce4b4361872ed6dba9f895d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f7d1c88224ebd85d15f7c43e7fe72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:58.037043 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0c2685c2-7006-4d8e-a1b8-3aaedf24dd19 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Searching by: {'deleted': False, 'project_id': '880f7d1c88224ebd85d15f7c43e7fe72'} {{(pid=126976) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 12 23:55:58.049103 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c2685c2-7006-4d8e-a1b8-3aaedf24dd19 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:58.050304 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c2685c2-7006-4d8e-a1b8-3aaedf24dd19 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:58.051022 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c2685c2-7006-4d8e-a1b8-3aaedf24dd19 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:58.052390 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c2685c2-7006-4d8e-a1b8-3aaedf24dd19 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:58.053128 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c2685c2-7006-4d8e-a1b8-3aaedf24dd19 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:58.053762 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c2685c2-7006-4d8e-a1b8-3aaedf24dd19 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:58.219951 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.multi_cell_list [None req-0c2685c2-7006-4d8e-a1b8-3aaedf24dd19 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=126976) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 12 23:55:58.292382 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d3252cc1-2766-463b-a535-0653fc92478a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:58.307384 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d3252cc1-2766-463b-a535-0653fc92478a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde" status: 200 len: 1367 microversion: 2.1 time: 0.468277 Sep 12 23:55:58.308242 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 160/316] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:57 2022] GET /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde => generated 1367 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:58.369511 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0c2685c2-7006-4d8e-a1b8-3aaedf24dd19 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.348837 Sep 12 23:55:58.370126 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 157/317] 10.222.0.26 () {58 vars in 1125 bytes} [Mon Sep 12 23:55:58 2022] GET /compute/v2.1/servers => generated 343 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:55:58.384699 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-512d4332-df5c-41e1-8c01-2e2c99564dd1 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:58.385480 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-512d4332-df5c-41e1-8c01-2e2c99564dd1 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] [instance: c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:58.392165 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-512d4332-df5c-41e1-8c01-2e2c99564dd1 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:58.392746 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-512d4332-df5c-41e1-8c01-2e2c99564dd1 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:58.393249 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-512d4332-df5c-41e1-8c01-2e2c99564dd1 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:58.394040 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-512d4332-df5c-41e1-8c01-2e2c99564dd1 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:58.394565 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-512d4332-df5c-41e1-8c01-2e2c99564dd1 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:58.394986 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-512d4332-df5c-41e1-8c01-2e2c99564dd1 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:58.732616 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-512d4332-df5c-41e1-8c01-2e2c99564dd1 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76b3353ce4b4361872ed6dba9f895d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f7d1c88224ebd85d15f7c43e7fe72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:58.741431 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-512d4332-df5c-41e1-8c01-2e2c99564dd1 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a" status: 200 len: 1550 microversion: 2.1 time: 0.361692 Sep 12 23:55:58.742024 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 161/318] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:58 2022] GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a => generated 1550 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:58.900445 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-991ff165-f608-41d1-a1ec-c8d413e2b503 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:58.902702 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-991ff165-f608-41d1-a1ec-c8d413e2b503 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:58.912920 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-991ff165-f608-41d1-a1ec-c8d413e2b503 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:58.913337 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-991ff165-f608-41d1-a1ec-c8d413e2b503 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:58.914321 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-991ff165-f608-41d1-a1ec-c8d413e2b503 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:58.915898 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-991ff165-f608-41d1-a1ec-c8d413e2b503 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:58.916812 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-991ff165-f608-41d1-a1ec-c8d413e2b503 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:58.917238 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-991ff165-f608-41d1-a1ec-c8d413e2b503 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:59.043915 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-eadb840d-b8a0-4ff2-8d57-8d82b40baa83 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:59.045262 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-eadb840d-b8a0-4ff2-8d57-8d82b40baa83 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 0be21a98-d3f6-4f26-8947-fd39015a7735] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:59.061857 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eadb840d-b8a0-4ff2-8d57-8d82b40baa83 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:59.062832 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eadb840d-b8a0-4ff2-8d57-8d82b40baa83 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:59.063507 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eadb840d-b8a0-4ff2-8d57-8d82b40baa83 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:59.064488 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eadb840d-b8a0-4ff2-8d57-8d82b40baa83 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:59.065143 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eadb840d-b8a0-4ff2-8d57-8d82b40baa83 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:59.065760 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eadb840d-b8a0-4ff2-8d57-8d82b40baa83 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:59.215873 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-991ff165-f608-41d1-a1ec-c8d413e2b503 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:59.233963 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-991ff165-f608-41d1-a1ec-c8d413e2b503 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:59.241772 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-991ff165-f608-41d1-a1ec-c8d413e2b503 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:59.245684 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-991ff165-f608-41d1-a1ec-c8d413e2b503 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1723 microversion: 2.20 time: 0.350971 Sep 12 23:55:59.248176 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 158/319] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:55:58 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1723 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:55:59.298922 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-081cf0e2-0628-458d-b78a-deb1529196d3 req-8b8d4e35-bb95-42ad-b908-ea03c5877be6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad5faa90-b5ff-47e2-abab-21418459ecde", "name": "network-vif-plugged", "status": "completed", "tag": "81ec905f-b1b8-4515-bb0c-1bc37b74e48f"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:55:59.314865 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-081cf0e2-0628-458d-b78a-deb1529196d3 req-8b8d4e35-bb95-42ad-b908-ea03c5877be6 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:59.315340 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-081cf0e2-0628-458d-b78a-deb1529196d3 req-8b8d4e35-bb95-42ad-b908-ea03c5877be6 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:59.315776 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-081cf0e2-0628-458d-b78a-deb1529196d3 req-8b8d4e35-bb95-42ad-b908-ea03c5877be6 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:59.329131 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-081cf0e2-0628-458d-b78a-deb1529196d3 req-8b8d4e35-bb95-42ad-b908-ea03c5877be6 service nova] Creating event network-vif-plugged:81ec905f-b1b8-4515-bb0c-1bc37b74e48f for instance ad5faa90-b5ff-47e2-abab-21418459ecde on hv-cinder-82002 Sep 12 23:55:59.334751 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-081cf0e2-0628-458d-b78a-deb1529196d3 req-8b8d4e35-bb95-42ad-b908-ea03c5877be6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039893 Sep 12 23:55:59.335782 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 159/320] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 23:55:59.343364 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1980e26f-b2af-4993-890d-99a9cd247d4f tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:55:59.344214 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1980e26f-b2af-4993-890d-99a9cd247d4f tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: ad5faa90-b5ff-47e2-abab-21418459ecde] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:55:59.353338 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1980e26f-b2af-4993-890d-99a9cd247d4f tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:59.354018 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1980e26f-b2af-4993-890d-99a9cd247d4f tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:59.355121 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1980e26f-b2af-4993-890d-99a9cd247d4f tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:59.355932 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1980e26f-b2af-4993-890d-99a9cd247d4f tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:55:59.356409 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1980e26f-b2af-4993-890d-99a9cd247d4f tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:55:59.356832 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1980e26f-b2af-4993-890d-99a9cd247d4f tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:55:59.362536 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-eadb840d-b8a0-4ff2-8d57-8d82b40baa83 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:59.372361 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-eadb840d-b8a0-4ff2-8d57-8d82b40baa83 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735" status: 200 len: 1371 microversion: 2.1 time: 0.332800 Sep 12 23:55:59.373439 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 162/321] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:59 2022] GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735 => generated 1371 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:55:59.508972 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-1980e26f-b2af-4993-890d-99a9cd247d4f tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:55:59.523260 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1980e26f-b2af-4993-890d-99a9cd247d4f tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde" status: 200 len: 1367 microversion: 2.1 time: 0.184847 Sep 12 23:55:59.524341 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 160/322] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:55:59 2022] GET /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:56:00.292553 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-098c6c4d-4241-41f6-9f07-6bd20488aab3 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:00.293166 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-098c6c4d-4241-41f6-9f07-6bd20488aab3 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:00.300349 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-098c6c4d-4241-41f6-9f07-6bd20488aab3 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:00.300843 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-098c6c4d-4241-41f6-9f07-6bd20488aab3 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:00.301329 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-098c6c4d-4241-41f6-9f07-6bd20488aab3 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:00.302036 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-098c6c4d-4241-41f6-9f07-6bd20488aab3 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:00.302464 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-098c6c4d-4241-41f6-9f07-6bd20488aab3 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:00.302922 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-098c6c4d-4241-41f6-9f07-6bd20488aab3 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:00.398478 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b9bb7678-6593-4e96-a11b-b50ff643bcb8 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:00.399077 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b9bb7678-6593-4e96-a11b-b50ff643bcb8 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 0be21a98-d3f6-4f26-8947-fd39015a7735] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:00.407578 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b9bb7678-6593-4e96-a11b-b50ff643bcb8 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:00.408153 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b9bb7678-6593-4e96-a11b-b50ff643bcb8 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:00.408791 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b9bb7678-6593-4e96-a11b-b50ff643bcb8 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:00.409901 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b9bb7678-6593-4e96-a11b-b50ff643bcb8 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:00.410518 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b9bb7678-6593-4e96-a11b-b50ff643bcb8 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:00.411012 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b9bb7678-6593-4e96-a11b-b50ff643bcb8 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:00.428265 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:56:00.537652 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-098c6c4d-4241-41f6-9f07-6bd20488aab3 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:00.546537 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-098c6c4d-4241-41f6-9f07-6bd20488aab3 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:00.553248 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-098c6c4d-4241-41f6-9f07-6bd20488aab3 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:00.554587 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-098c6c4d-4241-41f6-9f07-6bd20488aab3 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1723 microversion: 2.20 time: 0.265989 Sep 12 23:56:00.557284 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 163/323] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:56:00 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1723 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:56:00.569326 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8dd6fa54-f6dc-40a9-9a97-d36096783cc6 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7f59ceb4-d314-4dea-80d7-b100fdc1baf8"}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:56:00.575695 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8dd6fa54-f6dc-40a9-9a97-d36096783cc6 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] [instance: c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:00.590986 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8dd6fa54-f6dc-40a9-9a97-d36096783cc6 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:00.591659 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8dd6fa54-f6dc-40a9-9a97-d36096783cc6 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:00.592356 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8dd6fa54-f6dc-40a9-9a97-d36096783cc6 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:00.593069 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8dd6fa54-f6dc-40a9-9a97-d36096783cc6 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:00.593530 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8dd6fa54-f6dc-40a9-9a97-d36096783cc6 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:00.593955 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8dd6fa54-f6dc-40a9-9a97-d36096783cc6 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:00.711802 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b9bb7678-6593-4e96-a11b-b50ff643bcb8 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:00.721374 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b9bb7678-6593-4e96-a11b-b50ff643bcb8 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735" status: 200 len: 1371 microversion: 2.1 time: 0.327055 Sep 12 23:56:00.724306 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 161/324] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:56:00 2022] GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735 => generated 1371 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:56:00.731546 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1082639a-e7d9-435d-9a86-5f571167fc10 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:00.732377 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1082639a-e7d9-435d-9a86-5f571167fc10 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: ad5faa90-b5ff-47e2-abab-21418459ecde] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:00.745397 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1082639a-e7d9-435d-9a86-5f571167fc10 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:00.745974 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1082639a-e7d9-435d-9a86-5f571167fc10 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:00.746445 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1082639a-e7d9-435d-9a86-5f571167fc10 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:00.747444 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1082639a-e7d9-435d-9a86-5f571167fc10 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:00.747907 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1082639a-e7d9-435d-9a86-5f571167fc10 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:00.748328 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1082639a-e7d9-435d-9a86-5f571167fc10 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:00.983750 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8dd6fa54-f6dc-40a9-9a97-d36096783cc6 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "POST /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.423104 Sep 12 23:56:00.985095 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 164/325] 10.222.0.26 () {60 vars in 1323 bytes} [Mon Sep 12 23:56:00 2022] POST /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a/os-volume_attachments => generated 194 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:56:01.343420 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-1082639a-e7d9-435d-9a86-5f571167fc10 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:01.355341 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1082639a-e7d9-435d-9a86-5f571167fc10 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde" status: 200 len: 1367 microversion: 2.1 time: 0.631049 Sep 12 23:56:01.356328 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 162/326] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:56:00 2022] GET /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde => generated 1367 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:56:01.585327 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5518da90-ca14-4fb9-91ba-af4dd778863d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:01.586140 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5518da90-ca14-4fb9-91ba-af4dd778863d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:01.592850 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5518da90-ca14-4fb9-91ba-af4dd778863d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:01.593430 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5518da90-ca14-4fb9-91ba-af4dd778863d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:01.593801 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5518da90-ca14-4fb9-91ba-af4dd778863d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:01.594565 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5518da90-ca14-4fb9-91ba-af4dd778863d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:01.595021 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5518da90-ca14-4fb9-91ba-af4dd778863d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:01.595473 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5518da90-ca14-4fb9-91ba-af4dd778863d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:01.600077 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:56:01.746715 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-defd658d-4bea-474a-9937-27369fd98e00 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:01.747662 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-defd658d-4bea-474a-9937-27369fd98e00 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 0be21a98-d3f6-4f26-8947-fd39015a7735] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:01.754323 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-defd658d-4bea-474a-9937-27369fd98e00 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:01.754731 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-defd658d-4bea-474a-9937-27369fd98e00 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:01.755169 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-defd658d-4bea-474a-9937-27369fd98e00 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:01.755909 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-defd658d-4bea-474a-9937-27369fd98e00 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:01.756377 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-defd658d-4bea-474a-9937-27369fd98e00 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:01.756817 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-defd658d-4bea-474a-9937-27369fd98e00 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:01.847251 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5518da90-ca14-4fb9-91ba-af4dd778863d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:01.857132 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5518da90-ca14-4fb9-91ba-af4dd778863d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:01.858776 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5518da90-ca14-4fb9-91ba-af4dd778863d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:01.860214 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5518da90-ca14-4fb9-91ba-af4dd778863d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1726 microversion: 2.20 time: 0.279820 Sep 12 23:56:01.860784 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 165/327] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:56:01 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1726 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:56:01.890950 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-41200495-1557-4d76-b48e-f401fda80992 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f13be105-d158-455e-854a-336b9be668e5"}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:56:01.895677 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-41200495-1557-4d76-b48e-f401fda80992 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:01.907704 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-41200495-1557-4d76-b48e-f401fda80992 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:01.908540 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-41200495-1557-4d76-b48e-f401fda80992 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:01.909365 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-41200495-1557-4d76-b48e-f401fda80992 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:01.910703 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-41200495-1557-4d76-b48e-f401fda80992 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:01.911579 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-41200495-1557-4d76-b48e-f401fda80992 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:01.912244 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-41200495-1557-4d76-b48e-f401fda80992 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:01.997439 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-defd658d-4bea-474a-9937-27369fd98e00 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:02.006855 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-defd658d-4bea-474a-9937-27369fd98e00 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735" status: 200 len: 1371 microversion: 2.1 time: 0.264115 Sep 12 23:56:02.012762 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 163/328] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:56:01 2022] GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735 => generated 1371 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:56:02.040376 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-a3441777-abae-478a-8c97-25dd81cef4a1 req-ade03d98-0fae-40f8-ae54-a15f3df86643 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0be21a98-d3f6-4f26-8947-fd39015a7735", "tag": "36b2ab7e-5dbe-4019-ae5e-f401a7d7cdb1"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:56:02.084675 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-a3441777-abae-478a-8c97-25dd81cef4a1 req-ade03d98-0fae-40f8-ae54-a15f3df86643 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:02.085434 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-a3441777-abae-478a-8c97-25dd81cef4a1 req-ade03d98-0fae-40f8-ae54-a15f3df86643 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:02.086579 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-a3441777-abae-478a-8c97-25dd81cef4a1 req-ade03d98-0fae-40f8-ae54-a15f3df86643 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:02.100161 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-a3441777-abae-478a-8c97-25dd81cef4a1 req-ade03d98-0fae-40f8-ae54-a15f3df86643 service nova] Creating event network-changed:36b2ab7e-5dbe-4019-ae5e-f401a7d7cdb1 for instance 0be21a98-d3f6-4f26-8947-fd39015a7735 on hv-cinder-82002 Sep 12 23:56:02.106632 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-a3441777-abae-478a-8c97-25dd81cef4a1 req-ade03d98-0fae-40f8-ae54-a15f3df86643 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097671 Sep 12 23:56:02.107877 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 164/329] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:56:02.318576 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell0:SELECT=2 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:56:02.350764 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell0:SELECT=10 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:56:02.379295 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3012e5fe-b82f-43b8-946d-8d06fe8fb0e7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:02.380017 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3012e5fe-b82f-43b8-946d-8d06fe8fb0e7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: ad5faa90-b5ff-47e2-abab-21418459ecde] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:02.386565 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3012e5fe-b82f-43b8-946d-8d06fe8fb0e7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:02.387052 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3012e5fe-b82f-43b8-946d-8d06fe8fb0e7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:02.387680 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3012e5fe-b82f-43b8-946d-8d06fe8fb0e7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:02.388429 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3012e5fe-b82f-43b8-946d-8d06fe8fb0e7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:02.389215 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3012e5fe-b82f-43b8-946d-8d06fe8fb0e7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:02.390158 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3012e5fe-b82f-43b8-946d-8d06fe8fb0e7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:02.397973 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-41200495-1557-4d76-b48e-f401fda80992 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "POST /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.513988 Sep 12 23:56:02.399116 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 166/330] 10.222.0.26 () {62 vars in 1364 bytes} [Mon Sep 12 23:56:01 2022] POST /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65/os-volume_attachments => generated 188 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 12 23:56:02.557955 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-665c7417-5ebd-4643-8374-346826307c34 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:56:02.558842 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-665c7417-5ebd-4643-8374-346826307c34 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:02.560918 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3012e5fe-b82f-43b8-946d-8d06fe8fb0e7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:02.566079 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-665c7417-5ebd-4643-8374-346826307c34 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:02.566653 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-665c7417-5ebd-4643-8374-346826307c34 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:02.567142 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-665c7417-5ebd-4643-8374-346826307c34 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:02.567972 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-665c7417-5ebd-4643-8374-346826307c34 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:02.568509 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-665c7417-5ebd-4643-8374-346826307c34 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:02.569010 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-665c7417-5ebd-4643-8374-346826307c34 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:02.569266 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3012e5fe-b82f-43b8-946d-8d06fe8fb0e7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde" status: 200 len: 1367 microversion: 2.1 time: 0.194796 Sep 12 23:56:02.569860 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 165/331] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:56:02 2022] GET /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:56:02.617904 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-665c7417-5ebd-4643-8374-346826307c34 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=126975) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 12 23:56:02.695937 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-665c7417-5ebd-4643-8374-346826307c34 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "POST /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65/action" status: 202 len: 0 microversion: 2.20 time: 0.142013 Sep 12 23:56:02.696611 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 167/332] 10.222.0.26 () {62 vars in 1319 bytes} [Mon Sep 12 23:56:02 2022] POST /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 12 23:56:02.705321 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-55bc449c-08d6-40b2-a110-d6346f83408d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:02.705940 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-55bc449c-08d6-40b2-a110-d6346f83408d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:02.712174 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-55bc449c-08d6-40b2-a110-d6346f83408d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:02.712679 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-55bc449c-08d6-40b2-a110-d6346f83408d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:02.713118 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-55bc449c-08d6-40b2-a110-d6346f83408d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:02.713832 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-55bc449c-08d6-40b2-a110-d6346f83408d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:02.714287 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-55bc449c-08d6-40b2-a110-d6346f83408d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:02.714708 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-55bc449c-08d6-40b2-a110-d6346f83408d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:02.911172 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-55bc449c-08d6-40b2-a110-d6346f83408d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:02.928333 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-55bc449c-08d6-40b2-a110-d6346f83408d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:02.930025 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-55bc449c-08d6-40b2-a110-d6346f83408d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:02.931534 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-55bc449c-08d6-40b2-a110-d6346f83408d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1752 microversion: 2.20 time: 0.230319 Sep 12 23:56:02.932209 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 166/333] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:56:02 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1752 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 23:56:03.050429 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b273a682-71e8-42e3-9c9b-2ea39e341d0d tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:03.051052 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b273a682-71e8-42e3-9c9b-2ea39e341d0d tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 0be21a98-d3f6-4f26-8947-fd39015a7735] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:03.057916 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b273a682-71e8-42e3-9c9b-2ea39e341d0d tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:03.058673 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b273a682-71e8-42e3-9c9b-2ea39e341d0d tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:03.059557 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b273a682-71e8-42e3-9c9b-2ea39e341d0d tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:03.060472 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b273a682-71e8-42e3-9c9b-2ea39e341d0d tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:03.061361 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b273a682-71e8-42e3-9c9b-2ea39e341d0d tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:03.062588 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b273a682-71e8-42e3-9c9b-2ea39e341d0d tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:03.267761 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-f6de9979-49a5-4e3d-999e-218dc0966459 req-d25666f5-5ddd-446c-a72a-a409645fea80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "893ed869-802c-4a92-b7ab-d2aa8324fb65", "name": "network-vif-unplugged", "status": "completed", "tag": "3a5cf7e7-3d44-4786-8d75-99e5d72ef0e0"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:56:03.281043 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell0:SELECT=2 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:56:03.284816 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-f6de9979-49a5-4e3d-999e-218dc0966459 req-d25666f5-5ddd-446c-a72a-a409645fea80 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:03.285546 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-f6de9979-49a5-4e3d-999e-218dc0966459 req-d25666f5-5ddd-446c-a72a-a409645fea80 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:03.286122 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-f6de9979-49a5-4e3d-999e-218dc0966459 req-d25666f5-5ddd-446c-a72a-a409645fea80 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:03.299407 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.compute.server_external_events [req-f6de9979-49a5-4e3d-999e-218dc0966459 req-d25666f5-5ddd-446c-a72a-a409645fea80 service nova] Unable to find a host for instance 893ed869-802c-4a92-b7ab-d2aa8324fb65. Dropping event network-vif-unplugged {{(pid=126976) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 12 23:56:03.300588 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-f6de9979-49a5-4e3d-999e-218dc0966459 req-d25666f5-5ddd-446c-a72a-a409645fea80 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.045120 Sep 12 23:56:03.302060 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 167/334] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 47 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 12 23:56:03.426068 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b273a682-71e8-42e3-9c9b-2ea39e341d0d tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:03.440110 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b273a682-71e8-42e3-9c9b-2ea39e341d0d tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735" status: 200 len: 1371 microversion: 2.1 time: 0.391965 Sep 12 23:56:03.440110 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 168/335] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:56:03 2022] GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735 => generated 1371 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:56:03.592661 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e728bbcf-9919-4f0e-b7b5-df1056ce71fc tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:03.593391 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e728bbcf-9919-4f0e-b7b5-df1056ce71fc tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: ad5faa90-b5ff-47e2-abab-21418459ecde] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:03.600245 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e728bbcf-9919-4f0e-b7b5-df1056ce71fc tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:03.600775 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e728bbcf-9919-4f0e-b7b5-df1056ce71fc tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:03.601350 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e728bbcf-9919-4f0e-b7b5-df1056ce71fc tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:03.602072 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e728bbcf-9919-4f0e-b7b5-df1056ce71fc tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:03.602498 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e728bbcf-9919-4f0e-b7b5-df1056ce71fc tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:03.602918 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e728bbcf-9919-4f0e-b7b5-df1056ce71fc tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:03.756715 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e728bbcf-9919-4f0e-b7b5-df1056ce71fc tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:03.764727 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e728bbcf-9919-4f0e-b7b5-df1056ce71fc tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde" status: 200 len: 1557 microversion: 2.1 time: 0.176124 Sep 12 23:56:03.765405 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 168/336] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:56:03 2022] GET /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde => generated 1557 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:56:03.788418 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-54859c9d-ad8d-4f2a-bf0b-cbbe4c1a1576 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:03.789289 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-54859c9d-ad8d-4f2a-bf0b-cbbe4c1a1576 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: ad5faa90-b5ff-47e2-abab-21418459ecde] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:03.797698 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-54859c9d-ad8d-4f2a-bf0b-cbbe4c1a1576 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:03.798349 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-54859c9d-ad8d-4f2a-bf0b-cbbe4c1a1576 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:03.798854 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-54859c9d-ad8d-4f2a-bf0b-cbbe4c1a1576 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:03.800007 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-54859c9d-ad8d-4f2a-bf0b-cbbe4c1a1576 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:03.800525 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-54859c9d-ad8d-4f2a-bf0b-cbbe4c1a1576 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:03.801019 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-54859c9d-ad8d-4f2a-bf0b-cbbe4c1a1576 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:03.901645 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-54859c9d-ad8d-4f2a-bf0b-cbbe4c1a1576 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.117186 Sep 12 23:56:03.902288 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 169/337] 10.222.0.26 () {58 vars in 1275 bytes} [Mon Sep 12 23:56:03 2022] GET /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde/os-interface => generated 284 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:56:03.959614 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b980c309-110e-43da-b521-e85aa8b236a7 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:03.960827 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b980c309-110e-43da-b521-e85aa8b236a7 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:03.967579 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b980c309-110e-43da-b521-e85aa8b236a7 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:03.969310 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b980c309-110e-43da-b521-e85aa8b236a7 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:03.969950 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b980c309-110e-43da-b521-e85aa8b236a7 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:03.970982 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b980c309-110e-43da-b521-e85aa8b236a7 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:03.971458 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b980c309-110e-43da-b521-e85aa8b236a7 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:03.972136 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b980c309-110e-43da-b521-e85aa8b236a7 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:04.218475 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b980c309-110e-43da-b521-e85aa8b236a7 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:04.227832 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b980c309-110e-43da-b521-e85aa8b236a7 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:04.229266 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b980c309-110e-43da-b521-e85aa8b236a7 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:04.230448 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b980c309-110e-43da-b521-e85aa8b236a7 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1752 microversion: 2.20 time: 0.275180 Sep 12 23:56:04.231014 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 169/338] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:56:03 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1752 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:56:04.466427 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-97d16fd6-1331-4a0d-8d95-2164bbf1735b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:04.467745 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-97d16fd6-1331-4a0d-8d95-2164bbf1735b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 0be21a98-d3f6-4f26-8947-fd39015a7735] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:04.474408 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-97d16fd6-1331-4a0d-8d95-2164bbf1735b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:04.474891 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-97d16fd6-1331-4a0d-8d95-2164bbf1735b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:04.475384 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-97d16fd6-1331-4a0d-8d95-2164bbf1735b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:04.476086 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-97d16fd6-1331-4a0d-8d95-2164bbf1735b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:04.476521 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-97d16fd6-1331-4a0d-8d95-2164bbf1735b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:04.476957 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-97d16fd6-1331-4a0d-8d95-2164bbf1735b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:04.827428 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-97d16fd6-1331-4a0d-8d95-2164bbf1735b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:04.836060 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-97d16fd6-1331-4a0d-8d95-2164bbf1735b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735" status: 200 len: 1371 microversion: 2.1 time: 0.374606 Sep 12 23:56:04.836677 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 170/339] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:56:04 2022] GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735 => generated 1371 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:56:05.258047 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-75e0f71d-adb8-4b53-90a4-98dd4d7fa739 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:05.258047 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-75e0f71d-adb8-4b53-90a4-98dd4d7fa739 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:05.270084 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-0dfaf431-e9a3-4597-bf47-0db65f26661d req-2de7a80a-3a98-40e6-b21d-1ed757ff9acf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad5faa90-b5ff-47e2-abab-21418459ecde", "tag": "81ec905f-b1b8-4515-bb0c-1bc37b74e48f"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:56:05.276633 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-75e0f71d-adb8-4b53-90a4-98dd4d7fa739 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:05.277132 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-75e0f71d-adb8-4b53-90a4-98dd4d7fa739 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:05.292269 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-0dfaf431-e9a3-4597-bf47-0db65f26661d req-2de7a80a-3a98-40e6-b21d-1ed757ff9acf service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:05.292698 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-0dfaf431-e9a3-4597-bf47-0db65f26661d req-2de7a80a-3a98-40e6-b21d-1ed757ff9acf service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:05.293185 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-75e0f71d-adb8-4b53-90a4-98dd4d7fa739 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:05.294263 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-75e0f71d-adb8-4b53-90a4-98dd4d7fa739 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:05.294945 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-75e0f71d-adb8-4b53-90a4-98dd4d7fa739 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:05.295620 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-75e0f71d-adb8-4b53-90a4-98dd4d7fa739 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:05.299385 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-0dfaf431-e9a3-4597-bf47-0db65f26661d req-2de7a80a-3a98-40e6-b21d-1ed757ff9acf service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:05.327931 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-0dfaf431-e9a3-4597-bf47-0db65f26661d req-2de7a80a-3a98-40e6-b21d-1ed757ff9acf service nova] Creating event network-changed:81ec905f-b1b8-4515-bb0c-1bc37b74e48f for instance ad5faa90-b5ff-47e2-abab-21418459ecde on hv-cinder-82002 Sep 12 23:56:05.339561 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-0dfaf431-e9a3-4597-bf47-0db65f26661d req-2de7a80a-3a98-40e6-b21d-1ed757ff9acf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074391 Sep 12 23:56:05.346416 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 171/340] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:56:05.693979 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-75e0f71d-adb8-4b53-90a4-98dd4d7fa739 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:05.710535 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-75e0f71d-adb8-4b53-90a4-98dd4d7fa739 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:05.713366 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-75e0f71d-adb8-4b53-90a4-98dd4d7fa739 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:05.715837 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-75e0f71d-adb8-4b53-90a4-98dd4d7fa739 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1754 microversion: 2.20 time: 0.462873 Sep 12 23:56:05.716801 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 170/341] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:56:05 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1754 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:56:05.866880 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1f33cdb9-707d-4487-b236-2e92a934e8bf tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:05.868171 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1f33cdb9-707d-4487-b236-2e92a934e8bf tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 0be21a98-d3f6-4f26-8947-fd39015a7735] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:05.889157 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1f33cdb9-707d-4487-b236-2e92a934e8bf tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:05.891681 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1f33cdb9-707d-4487-b236-2e92a934e8bf tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:05.892558 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1f33cdb9-707d-4487-b236-2e92a934e8bf tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:05.894622 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1f33cdb9-707d-4487-b236-2e92a934e8bf tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:05.896114 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1f33cdb9-707d-4487-b236-2e92a934e8bf tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:05.896553 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1f33cdb9-707d-4487-b236-2e92a934e8bf tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:06.134068 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-1f33cdb9-707d-4487-b236-2e92a934e8bf tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:06.147313 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1f33cdb9-707d-4487-b236-2e92a934e8bf tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735" status: 200 len: 1371 microversion: 2.1 time: 0.290500 Sep 12 23:56:06.147934 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 172/342] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:56:05 2022] GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735 => generated 1371 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:56:06.759889 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f98a2997-2aa4-4143-beb5-71fa0bcb0df4 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:06.760506 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f98a2997-2aa4-4143-beb5-71fa0bcb0df4 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:06.767720 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f98a2997-2aa4-4143-beb5-71fa0bcb0df4 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:06.768246 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f98a2997-2aa4-4143-beb5-71fa0bcb0df4 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:06.768714 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f98a2997-2aa4-4143-beb5-71fa0bcb0df4 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:06.769443 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f98a2997-2aa4-4143-beb5-71fa0bcb0df4 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:06.769881 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f98a2997-2aa4-4143-beb5-71fa0bcb0df4 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:06.770307 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f98a2997-2aa4-4143-beb5-71fa0bcb0df4 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:06.915532 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f98a2997-2aa4-4143-beb5-71fa0bcb0df4 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:06.928451 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f98a2997-2aa4-4143-beb5-71fa0bcb0df4 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:06.929846 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f98a2997-2aa4-4143-beb5-71fa0bcb0df4 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:06.931083 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f98a2997-2aa4-4143-beb5-71fa0bcb0df4 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1754 microversion: 2.20 time: 0.175183 Sep 12 23:56:06.931696 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 171/343] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:56:06 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1754 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:56:07.171091 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a1d55708-0bcb-45e5-87b6-319cc41d12ac tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:07.171678 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a1d55708-0bcb-45e5-87b6-319cc41d12ac tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 0be21a98-d3f6-4f26-8947-fd39015a7735] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:07.184075 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a1d55708-0bcb-45e5-87b6-319cc41d12ac tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:07.184430 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a1d55708-0bcb-45e5-87b6-319cc41d12ac tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:07.184898 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a1d55708-0bcb-45e5-87b6-319cc41d12ac tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:07.185628 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a1d55708-0bcb-45e5-87b6-319cc41d12ac tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:07.186087 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a1d55708-0bcb-45e5-87b6-319cc41d12ac tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:07.186506 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a1d55708-0bcb-45e5-87b6-319cc41d12ac tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:07.363423 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a1d55708-0bcb-45e5-87b6-319cc41d12ac tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:07.371522 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a1d55708-0bcb-45e5-87b6-319cc41d12ac tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735" status: 200 len: 1371 microversion: 2.1 time: 0.204577 Sep 12 23:56:07.372114 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 173/344] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:56:07 2022] GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735 => generated 1371 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:56:07.957050 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-89f34683-b2b4-4c7c-aa62-76d72620452e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:07.957741 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-89f34683-b2b4-4c7c-aa62-76d72620452e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:07.965263 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-89f34683-b2b4-4c7c-aa62-76d72620452e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:07.965751 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-89f34683-b2b4-4c7c-aa62-76d72620452e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:07.966175 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-89f34683-b2b4-4c7c-aa62-76d72620452e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:07.966913 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-89f34683-b2b4-4c7c-aa62-76d72620452e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:07.967385 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-89f34683-b2b4-4c7c-aa62-76d72620452e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:07.967800 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-89f34683-b2b4-4c7c-aa62-76d72620452e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:08.114647 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell0:SELECT=2 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:56:08.127759 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-89f34683-b2b4-4c7c-aa62-76d72620452e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:08.137698 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-89f34683-b2b4-4c7c-aa62-76d72620452e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:08.139140 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-89f34683-b2b4-4c7c-aa62-76d72620452e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:08.140354 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-89f34683-b2b4-4c7c-aa62-76d72620452e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1754 microversion: 2.20 time: 0.187452 Sep 12 23:56:08.140905 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 172/345] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:56:07 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1754 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:56:08.396121 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4c11edfe-6cca-4409-8eb5-0b0db22e1612 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:08.396794 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4c11edfe-6cca-4409-8eb5-0b0db22e1612 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 0be21a98-d3f6-4f26-8947-fd39015a7735] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:08.404436 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4c11edfe-6cca-4409-8eb5-0b0db22e1612 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:08.405177 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4c11edfe-6cca-4409-8eb5-0b0db22e1612 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:08.405895 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4c11edfe-6cca-4409-8eb5-0b0db22e1612 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:08.407058 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4c11edfe-6cca-4409-8eb5-0b0db22e1612 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:08.407864 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4c11edfe-6cca-4409-8eb5-0b0db22e1612 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:08.408642 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4c11edfe-6cca-4409-8eb5-0b0db22e1612 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:08.570664 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4c11edfe-6cca-4409-8eb5-0b0db22e1612 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:08.579923 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4c11edfe-6cca-4409-8eb5-0b0db22e1612 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735" status: 200 len: 1371 microversion: 2.1 time: 0.188928 Sep 12 23:56:08.580521 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 174/346] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:56:08 2022] GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735 => generated 1371 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:56:09.181343 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-fdb2fe3e-9c78-40af-87d5-5ca159c5d4bf tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:09.187473 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-fdb2fe3e-9c78-40af-87d5-5ca159c5d4bf tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:09.207628 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fdb2fe3e-9c78-40af-87d5-5ca159c5d4bf tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:09.208123 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fdb2fe3e-9c78-40af-87d5-5ca159c5d4bf tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:09.208559 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fdb2fe3e-9c78-40af-87d5-5ca159c5d4bf tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:09.209279 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fdb2fe3e-9c78-40af-87d5-5ca159c5d4bf tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:09.212066 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fdb2fe3e-9c78-40af-87d5-5ca159c5d4bf tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:09.212497 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fdb2fe3e-9c78-40af-87d5-5ca159c5d4bf tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:09.224302 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-a8956b9b-75c8-499c-96ae-3befac2d62e3 req-7a91ecb0-5255-4ff7-89df-0d6d09220921 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0be21a98-d3f6-4f26-8947-fd39015a7735", "name": "network-vif-plugged", "status": "completed", "tag": "36b2ab7e-5dbe-4019-ae5e-f401a7d7cdb1"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:56:09.242322 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-a8956b9b-75c8-499c-96ae-3befac2d62e3 req-7a91ecb0-5255-4ff7-89df-0d6d09220921 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:09.243118 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-a8956b9b-75c8-499c-96ae-3befac2d62e3 req-7a91ecb0-5255-4ff7-89df-0d6d09220921 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:09.243790 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-a8956b9b-75c8-499c-96ae-3befac2d62e3 req-7a91ecb0-5255-4ff7-89df-0d6d09220921 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:09.257051 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-a8956b9b-75c8-499c-96ae-3befac2d62e3 req-7a91ecb0-5255-4ff7-89df-0d6d09220921 service nova] Creating event network-vif-plugged:36b2ab7e-5dbe-4019-ae5e-f401a7d7cdb1 for instance 0be21a98-d3f6-4f26-8947-fd39015a7735 on hv-cinder-82002 Sep 12 23:56:09.263021 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-a8956b9b-75c8-499c-96ae-3befac2d62e3 req-7a91ecb0-5255-4ff7-89df-0d6d09220921 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042744 Sep 12 23:56:09.263697 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 175/347] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:56:09.493354 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-fdb2fe3e-9c78-40af-87d5-5ca159c5d4bf tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:09.502760 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-fdb2fe3e-9c78-40af-87d5-5ca159c5d4bf tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:09.504258 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-fdb2fe3e-9c78-40af-87d5-5ca159c5d4bf tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:09.505445 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-fdb2fe3e-9c78-40af-87d5-5ca159c5d4bf tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1754 microversion: 2.20 time: 0.337388 Sep 12 23:56:09.506012 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 173/348] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:56:09 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1754 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:56:09.603552 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ff2b0623-f653-4c5f-83a9-06ccf2c524c4 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:09.604310 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ff2b0623-f653-4c5f-83a9-06ccf2c524c4 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 0be21a98-d3f6-4f26-8947-fd39015a7735] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:09.613851 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ff2b0623-f653-4c5f-83a9-06ccf2c524c4 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:09.614613 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ff2b0623-f653-4c5f-83a9-06ccf2c524c4 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:09.615363 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ff2b0623-f653-4c5f-83a9-06ccf2c524c4 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:09.615994 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ff2b0623-f653-4c5f-83a9-06ccf2c524c4 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:09.616443 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ff2b0623-f653-4c5f-83a9-06ccf2c524c4 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:09.617032 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ff2b0623-f653-4c5f-83a9-06ccf2c524c4 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:09.756866 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ff2b0623-f653-4c5f-83a9-06ccf2c524c4 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:09.764587 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ff2b0623-f653-4c5f-83a9-06ccf2c524c4 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735" status: 200 len: 1371 microversion: 2.1 time: 0.166115 Sep 12 23:56:09.765135 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 176/349] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:56:09 2022] GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735 => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:56:09.797329 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-14c179fe-abfd-4647-a452-6b208ff8a90a tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:09.797936 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-14c179fe-abfd-4647-a452-6b208ff8a90a tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] [instance: c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:09.804629 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-14c179fe-abfd-4647-a452-6b208ff8a90a tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:09.805108 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-14c179fe-abfd-4647-a452-6b208ff8a90a tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:09.805536 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-14c179fe-abfd-4647-a452-6b208ff8a90a tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:09.806231 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-14c179fe-abfd-4647-a452-6b208ff8a90a tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:09.806753 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-14c179fe-abfd-4647-a452-6b208ff8a90a tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:09.807099 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-14c179fe-abfd-4647-a452-6b208ff8a90a tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:10.023690 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-14c179fe-abfd-4647-a452-6b208ff8a90a tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76b3353ce4b4361872ed6dba9f895d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f7d1c88224ebd85d15f7c43e7fe72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:10.033106 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-14c179fe-abfd-4647-a452-6b208ff8a90a tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a" status: 200 len: 1596 microversion: 2.1 time: 0.239929 Sep 12 23:56:10.033773 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 174/350] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:56:09 2022] GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a => generated 1596 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:56:10.533296 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8ec0ef40-c113-47e4-92ec-d76e131452bf tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:10.534002 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8ec0ef40-c113-47e4-92ec-d76e131452bf tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:10.540525 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8ec0ef40-c113-47e4-92ec-d76e131452bf tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:10.541009 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8ec0ef40-c113-47e4-92ec-d76e131452bf tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:10.541438 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8ec0ef40-c113-47e4-92ec-d76e131452bf tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:10.542156 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8ec0ef40-c113-47e4-92ec-d76e131452bf tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:10.542605 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8ec0ef40-c113-47e4-92ec-d76e131452bf tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:10.543023 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8ec0ef40-c113-47e4-92ec-d76e131452bf tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:10.696866 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8ec0ef40-c113-47e4-92ec-d76e131452bf tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:10.706493 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8ec0ef40-c113-47e4-92ec-d76e131452bf tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:10.708448 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8ec0ef40-c113-47e4-92ec-d76e131452bf tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:10.709832 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8ec0ef40-c113-47e4-92ec-d76e131452bf tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1810 microversion: 2.20 time: 0.180661 Sep 12 23:56:10.710556 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 177/351] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:56:10 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1810 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:56:10.789131 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-bb0d6c9d-2601-44d2-8010-48556d0309e1 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:10.789960 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-bb0d6c9d-2601-44d2-8010-48556d0309e1 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 0be21a98-d3f6-4f26-8947-fd39015a7735] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:10.798834 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bb0d6c9d-2601-44d2-8010-48556d0309e1 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:10.799369 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bb0d6c9d-2601-44d2-8010-48556d0309e1 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:10.799803 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bb0d6c9d-2601-44d2-8010-48556d0309e1 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:10.800838 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bb0d6c9d-2601-44d2-8010-48556d0309e1 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:10.801496 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bb0d6c9d-2601-44d2-8010-48556d0309e1 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:10.802164 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bb0d6c9d-2601-44d2-8010-48556d0309e1 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:10.955078 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-bb0d6c9d-2601-44d2-8010-48556d0309e1 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:10.963384 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-bb0d6c9d-2601-44d2-8010-48556d0309e1 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735" status: 200 len: 1371 microversion: 2.1 time: 0.179103 Sep 12 23:56:10.963958 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 175/352] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:56:10 2022] GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735 => generated 1371 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:56:11.737116 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e61116bf-70d6-4319-a471-c620c4716021 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:11.737720 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e61116bf-70d6-4319-a471-c620c4716021 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:11.744461 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e61116bf-70d6-4319-a471-c620c4716021 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:11.744929 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e61116bf-70d6-4319-a471-c620c4716021 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:11.745398 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e61116bf-70d6-4319-a471-c620c4716021 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:11.746048 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e61116bf-70d6-4319-a471-c620c4716021 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:11.746501 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e61116bf-70d6-4319-a471-c620c4716021 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:11.746906 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e61116bf-70d6-4319-a471-c620c4716021 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:11.902381 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e61116bf-70d6-4319-a471-c620c4716021 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:11.918346 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e61116bf-70d6-4319-a471-c620c4716021 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:11.919890 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e61116bf-70d6-4319-a471-c620c4716021 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:11.921108 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e61116bf-70d6-4319-a471-c620c4716021 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1810 microversion: 2.20 time: 0.188567 Sep 12 23:56:11.922249 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 178/353] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:56:11 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1810 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:56:11.986183 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-93c270c3-46be-4ca5-88ef-74c01ec69c59 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:11.987674 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-93c270c3-46be-4ca5-88ef-74c01ec69c59 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 0be21a98-d3f6-4f26-8947-fd39015a7735] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:11.994699 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-93c270c3-46be-4ca5-88ef-74c01ec69c59 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:11.995213 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-93c270c3-46be-4ca5-88ef-74c01ec69c59 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:11.995665 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-93c270c3-46be-4ca5-88ef-74c01ec69c59 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:11.996336 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-93c270c3-46be-4ca5-88ef-74c01ec69c59 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:11.996778 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-93c270c3-46be-4ca5-88ef-74c01ec69c59 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:11.997188 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-93c270c3-46be-4ca5-88ef-74c01ec69c59 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:12.101805 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-9698d8c7-eeda-46ce-8a4c-ab1ae82e63d1 req-28fa5198-ae7a-4129-9376-e468222bce6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a", "tag": "57c9f24f-46a8-416f-96ec-1d08fd0338ff"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:56:12.128353 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-9698d8c7-eeda-46ce-8a4c-ab1ae82e63d1 req-28fa5198-ae7a-4129-9376-e468222bce6f service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:12.129842 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-9698d8c7-eeda-46ce-8a4c-ab1ae82e63d1 req-28fa5198-ae7a-4129-9376-e468222bce6f service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:12.130959 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-9698d8c7-eeda-46ce-8a4c-ab1ae82e63d1 req-28fa5198-ae7a-4129-9376-e468222bce6f service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:12.149590 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-9698d8c7-eeda-46ce-8a4c-ab1ae82e63d1 req-28fa5198-ae7a-4129-9376-e468222bce6f service nova] Creating event network-changed:57c9f24f-46a8-416f-96ec-1d08fd0338ff for instance c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a on hv-cinder-82002 Sep 12 23:56:12.159783 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-9698d8c7-eeda-46ce-8a4c-ab1ae82e63d1 req-28fa5198-ae7a-4129-9376-e468222bce6f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067302 Sep 12 23:56:12.162452 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 179/354] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 23:56:12.286105 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-93c270c3-46be-4ca5-88ef-74c01ec69c59 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:12.302273 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-93c270c3-46be-4ca5-88ef-74c01ec69c59 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735" status: 200 len: 1565 microversion: 2.1 time: 0.319155 Sep 12 23:56:12.303877 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 176/355] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:56:11 2022] GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735 => generated 1565 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:56:12.330298 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f4cacef8-697b-4026-9f9d-880d7f7048b5 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:12.331039 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f4cacef8-697b-4026-9f9d-880d7f7048b5 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 0be21a98-d3f6-4f26-8947-fd39015a7735] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:12.345924 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4cacef8-697b-4026-9f9d-880d7f7048b5 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:12.346857 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4cacef8-697b-4026-9f9d-880d7f7048b5 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:12.348472 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4cacef8-697b-4026-9f9d-880d7f7048b5 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:12.349249 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4cacef8-697b-4026-9f9d-880d7f7048b5 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:12.350347 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4cacef8-697b-4026-9f9d-880d7f7048b5 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:12.351555 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4cacef8-697b-4026-9f9d-880d7f7048b5 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:12.374899 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:56:12.546434 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f4cacef8-697b-4026-9f9d-880d7f7048b5 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.221495 Sep 12 23:56:12.549721 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 180/356] 10.222.0.26 () {58 vars in 1275 bytes} [Mon Sep 12 23:56:12 2022] GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735/os-interface => generated 284 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:56:12.947718 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0e2dd300-3bfc-4feb-8d55-4f2a24b7be8d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:12.948601 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0e2dd300-3bfc-4feb-8d55-4f2a24b7be8d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:12.954742 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0e2dd300-3bfc-4feb-8d55-4f2a24b7be8d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:12.955593 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0e2dd300-3bfc-4feb-8d55-4f2a24b7be8d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:12.956171 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0e2dd300-3bfc-4feb-8d55-4f2a24b7be8d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:12.957028 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0e2dd300-3bfc-4feb-8d55-4f2a24b7be8d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:12.957626 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0e2dd300-3bfc-4feb-8d55-4f2a24b7be8d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:12.958185 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0e2dd300-3bfc-4feb-8d55-4f2a24b7be8d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:13.342150 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0e2dd300-3bfc-4feb-8d55-4f2a24b7be8d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:13.369257 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0e2dd300-3bfc-4feb-8d55-4f2a24b7be8d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:13.376580 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0e2dd300-3bfc-4feb-8d55-4f2a24b7be8d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:13.379538 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0e2dd300-3bfc-4feb-8d55-4f2a24b7be8d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1810 microversion: 2.20 time: 0.435720 Sep 12 23:56:13.398994 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 177/357] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:56:12 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1810 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:56:13.967065 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-74eb473d-756d-43ab-906e-2863ad8ca962 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-322726012"}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:56:13.970611 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-74eb473d-756d-43ab-906e-2863ad8ca962 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] [instance: c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:13.982616 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-74eb473d-756d-43ab-906e-2863ad8ca962 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:13.983413 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-74eb473d-756d-43ab-906e-2863ad8ca962 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:13.984003 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-74eb473d-756d-43ab-906e-2863ad8ca962 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:13.984927 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-74eb473d-756d-43ab-906e-2863ad8ca962 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:13.986574 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-74eb473d-756d-43ab-906e-2863ad8ca962 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:13.987245 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-74eb473d-756d-43ab-906e-2863ad8ca962 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:14.181991 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-27862786-93fe-4567-a1e9-8c39fbca95da req-3ebbc6ad-e9cf-4c1d-9ecc-1e5b105a2a6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0be21a98-d3f6-4f26-8947-fd39015a7735", "tag": "36b2ab7e-5dbe-4019-ae5e-f401a7d7cdb1"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:56:14.197320 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-27862786-93fe-4567-a1e9-8c39fbca95da req-3ebbc6ad-e9cf-4c1d-9ecc-1e5b105a2a6f service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:14.202117 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-27862786-93fe-4567-a1e9-8c39fbca95da req-3ebbc6ad-e9cf-4c1d-9ecc-1e5b105a2a6f service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:14.202779 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-27862786-93fe-4567-a1e9-8c39fbca95da req-3ebbc6ad-e9cf-4c1d-9ecc-1e5b105a2a6f service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:14.219387 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-27862786-93fe-4567-a1e9-8c39fbca95da req-3ebbc6ad-e9cf-4c1d-9ecc-1e5b105a2a6f service nova] Creating event network-changed:36b2ab7e-5dbe-4019-ae5e-f401a7d7cdb1 for instance 0be21a98-d3f6-4f26-8947-fd39015a7735 on hv-cinder-82002 Sep 12 23:56:14.227263 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.network.security_group_api [None req-74eb473d-756d-43ab-906e-2863ad8ca962 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Adding security group 13203dc5-2165-400b-9f8d-a87a9b53aa17 to port 57c9f24f-46a8-416f-96ec-1d08fd0338ff Sep 12 23:56:14.237312 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-27862786-93fe-4567-a1e9-8c39fbca95da req-3ebbc6ad-e9cf-4c1d-9ecc-1e5b105a2a6f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059084 Sep 12 23:56:14.240910 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 178/358] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 23:56:14.409621 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e4286242-4978-47ae-b94a-37176762e88c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:14.410578 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e4286242-4978-47ae-b94a-37176762e88c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:14.422762 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e4286242-4978-47ae-b94a-37176762e88c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:14.423269 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e4286242-4978-47ae-b94a-37176762e88c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:14.423720 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e4286242-4978-47ae-b94a-37176762e88c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:14.426538 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e4286242-4978-47ae-b94a-37176762e88c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:14.429095 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e4286242-4978-47ae-b94a-37176762e88c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:14.429654 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e4286242-4978-47ae-b94a-37176762e88c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:14.788226 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e4286242-4978-47ae-b94a-37176762e88c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:14.806051 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e4286242-4978-47ae-b94a-37176762e88c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:14.809125 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e4286242-4978-47ae-b94a-37176762e88c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:14.811479 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e4286242-4978-47ae-b94a-37176762e88c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1810 microversion: 2.20 time: 0.408220 Sep 12 23:56:14.819963 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 179/359] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:56:14 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1810 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 23:56:14.871200 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-74eb473d-756d-43ab-906e-2863ad8ca962 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "POST /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a/action" status: 202 len: 0 microversion: 2.1 time: 0.908703 Sep 12 23:56:14.878500 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 181/360] 10.222.0.26 () {60 vars in 1278 bytes} [Mon Sep 12 23:56:13 2022] POST /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a/action => generated 0 bytes in 917 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 23:56:14.883942 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-96bce16a-8138-402b-ace5-e72c23e3105f tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:14.885058 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-96bce16a-8138-402b-ace5-e72c23e3105f tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] [instance: c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:14.898029 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-96bce16a-8138-402b-ace5-e72c23e3105f tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:14.899672 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-96bce16a-8138-402b-ace5-e72c23e3105f tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:14.903800 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-96bce16a-8138-402b-ace5-e72c23e3105f tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:14.907636 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-96bce16a-8138-402b-ace5-e72c23e3105f tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:14.909930 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-96bce16a-8138-402b-ace5-e72c23e3105f tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:14.913357 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-96bce16a-8138-402b-ace5-e72c23e3105f tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:14.927492 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:56:14.939698 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-76110a2f-9569-4a0e-99cf-e9a146a51f8f req-11dec70d-a523-4734-a73d-a76d764e334a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a", "tag": "57c9f24f-46a8-416f-96ec-1d08fd0338ff"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:56:14.958761 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-76110a2f-9569-4a0e-99cf-e9a146a51f8f req-11dec70d-a523-4734-a73d-a76d764e334a service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:14.962307 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-76110a2f-9569-4a0e-99cf-e9a146a51f8f req-11dec70d-a523-4734-a73d-a76d764e334a service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:14.963027 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-76110a2f-9569-4a0e-99cf-e9a146a51f8f req-11dec70d-a523-4734-a73d-a76d764e334a service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:14.990803 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-76110a2f-9569-4a0e-99cf-e9a146a51f8f req-11dec70d-a523-4734-a73d-a76d764e334a service nova] Creating event network-changed:57c9f24f-46a8-416f-96ec-1d08fd0338ff for instance c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a on hv-cinder-82002 Sep 12 23:56:15.004280 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-76110a2f-9569-4a0e-99cf-e9a146a51f8f req-11dec70d-a523-4734-a73d-a76d764e334a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069383 Sep 12 23:56:15.005687 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 182/361] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 23:56:15.236757 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-96bce16a-8138-402b-ace5-e72c23e3105f tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76b3353ce4b4361872ed6dba9f895d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f7d1c88224ebd85d15f7c43e7fe72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:15.253027 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-96bce16a-8138-402b-ace5-e72c23e3105f tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a" status: 200 len: 1761 microversion: 2.1 time: 0.373075 Sep 12 23:56:15.264632 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 180/362] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:56:14 2022] GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a => generated 1761 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:56:15.869112 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-04b0fcf8-efda-453c-8e82-bc29d28f65bf tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:15.870344 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-04b0fcf8-efda-453c-8e82-bc29d28f65bf tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:15.878106 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-04b0fcf8-efda-453c-8e82-bc29d28f65bf tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:15.879017 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-04b0fcf8-efda-453c-8e82-bc29d28f65bf tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:15.879638 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-04b0fcf8-efda-453c-8e82-bc29d28f65bf tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:15.880556 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-04b0fcf8-efda-453c-8e82-bc29d28f65bf tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:15.881470 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-04b0fcf8-efda-453c-8e82-bc29d28f65bf tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:15.882075 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-04b0fcf8-efda-453c-8e82-bc29d28f65bf tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:16.081541 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-04b0fcf8-efda-453c-8e82-bc29d28f65bf tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:16.091490 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-04b0fcf8-efda-453c-8e82-bc29d28f65bf tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:16.093065 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-04b0fcf8-efda-453c-8e82-bc29d28f65bf tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:16.094237 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-04b0fcf8-efda-453c-8e82-bc29d28f65bf tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1810 microversion: 2.20 time: 0.231764 Sep 12 23:56:16.094808 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 183/363] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:56:15 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1810 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:56:17.123422 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f3341405-0425-4465-b881-075df281e97a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:17.123422 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f3341405-0425-4465-b881-075df281e97a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:17.130499 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f3341405-0425-4465-b881-075df281e97a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:17.130986 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f3341405-0425-4465-b881-075df281e97a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:17.131470 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f3341405-0425-4465-b881-075df281e97a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:17.132189 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f3341405-0425-4465-b881-075df281e97a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:17.132643 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f3341405-0425-4465-b881-075df281e97a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:17.133059 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f3341405-0425-4465-b881-075df281e97a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:17.291098 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f3341405-0425-4465-b881-075df281e97a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:17.300705 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f3341405-0425-4465-b881-075df281e97a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:17.302284 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f3341405-0425-4465-b881-075df281e97a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:17.303566 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f3341405-0425-4465-b881-075df281e97a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1810 microversion: 2.20 time: 0.185719 Sep 12 23:56:17.304221 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 181/364] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:56:17 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1810 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:56:18.337405 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1dbea606-4d87-47bb-89b6-6e041922baa8 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:18.338499 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1dbea606-4d87-47bb-89b6-6e041922baa8 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:18.347543 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1dbea606-4d87-47bb-89b6-6e041922baa8 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:18.348034 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1dbea606-4d87-47bb-89b6-6e041922baa8 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:18.348443 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1dbea606-4d87-47bb-89b6-6e041922baa8 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:18.349191 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1dbea606-4d87-47bb-89b6-6e041922baa8 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:18.349654 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1dbea606-4d87-47bb-89b6-6e041922baa8 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:18.350075 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1dbea606-4d87-47bb-89b6-6e041922baa8 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:18.511069 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-1dbea606-4d87-47bb-89b6-6e041922baa8 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:18.527704 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-1dbea606-4d87-47bb-89b6-6e041922baa8 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:18.529952 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-1dbea606-4d87-47bb-89b6-6e041922baa8 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:18.531857 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1dbea606-4d87-47bb-89b6-6e041922baa8 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1810 microversion: 2.20 time: 0.202154 Sep 12 23:56:18.532811 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 184/365] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:56:18 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1810 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:56:19.560344 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2d805c21-9444-4c76-ab8a-7a2571361146 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:19.561075 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2d805c21-9444-4c76-ab8a-7a2571361146 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:19.569192 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2d805c21-9444-4c76-ab8a-7a2571361146 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:19.569979 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2d805c21-9444-4c76-ab8a-7a2571361146 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:19.570559 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2d805c21-9444-4c76-ab8a-7a2571361146 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:19.571452 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2d805c21-9444-4c76-ab8a-7a2571361146 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:19.572263 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2d805c21-9444-4c76-ab8a-7a2571361146 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:19.572889 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2d805c21-9444-4c76-ab8a-7a2571361146 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:19.718451 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2d805c21-9444-4c76-ab8a-7a2571361146 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:19.727790 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2d805c21-9444-4c76-ab8a-7a2571361146 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:19.729154 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2d805c21-9444-4c76-ab8a-7a2571361146 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:19.730346 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2d805c21-9444-4c76-ab8a-7a2571361146 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1810 microversion: 2.20 time: 0.174167 Sep 12 23:56:19.730901 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 182/366] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:56:19 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1810 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:56:20.762040 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d7aba650-1100-4308-830a-11a3a0fd4ae5 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:20.763526 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d7aba650-1100-4308-830a-11a3a0fd4ae5 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:20.765826 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:56:20.772129 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d7aba650-1100-4308-830a-11a3a0fd4ae5 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:20.772618 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d7aba650-1100-4308-830a-11a3a0fd4ae5 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:20.773116 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d7aba650-1100-4308-830a-11a3a0fd4ae5 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:20.773765 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d7aba650-1100-4308-830a-11a3a0fd4ae5 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:20.774212 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d7aba650-1100-4308-830a-11a3a0fd4ae5 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:20.774629 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d7aba650-1100-4308-830a-11a3a0fd4ae5 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:20.928832 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d7aba650-1100-4308-830a-11a3a0fd4ae5 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:20.938553 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d7aba650-1100-4308-830a-11a3a0fd4ae5 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:20.940028 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d7aba650-1100-4308-830a-11a3a0fd4ae5 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:20.941219 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d7aba650-1100-4308-830a-11a3a0fd4ae5 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1810 microversion: 2.20 time: 0.184227 Sep 12 23:56:20.941815 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 185/367] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:56:20 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1810 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:56:21.968266 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f1d74624-ccaa-49be-a54f-ab63a46d2f1d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:21.969027 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f1d74624-ccaa-49be-a54f-ab63a46d2f1d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:21.971723 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=80 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:56:21.977760 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f1d74624-ccaa-49be-a54f-ab63a46d2f1d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:21.978294 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f1d74624-ccaa-49be-a54f-ab63a46d2f1d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:21.978763 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f1d74624-ccaa-49be-a54f-ab63a46d2f1d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:21.979464 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f1d74624-ccaa-49be-a54f-ab63a46d2f1d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:21.979950 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f1d74624-ccaa-49be-a54f-ab63a46d2f1d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:21.980341 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f1d74624-ccaa-49be-a54f-ab63a46d2f1d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:22.133020 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f1d74624-ccaa-49be-a54f-ab63a46d2f1d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:22.142436 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f1d74624-ccaa-49be-a54f-ab63a46d2f1d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:22.143975 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f1d74624-ccaa-49be-a54f-ab63a46d2f1d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:22.145194 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f1d74624-ccaa-49be-a54f-ab63a46d2f1d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1810 microversion: 2.20 time: 0.181217 Sep 12 23:56:22.145762 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 183/368] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:56:21 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1810 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:56:23.173792 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a5b5619e-913d-4596-889b-5212ee05b3bb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:23.174440 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a5b5619e-913d-4596-889b-5212ee05b3bb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:23.183461 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a5b5619e-913d-4596-889b-5212ee05b3bb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:23.183461 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a5b5619e-913d-4596-889b-5212ee05b3bb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:23.183461 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a5b5619e-913d-4596-889b-5212ee05b3bb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:23.189686 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a5b5619e-913d-4596-889b-5212ee05b3bb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:23.189686 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a5b5619e-913d-4596-889b-5212ee05b3bb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:23.189686 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a5b5619e-913d-4596-889b-5212ee05b3bb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:23.336104 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a5b5619e-913d-4596-889b-5212ee05b3bb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:23.345039 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a5b5619e-913d-4596-889b-5212ee05b3bb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:23.346561 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a5b5619e-913d-4596-889b-5212ee05b3bb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:23.347745 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a5b5619e-913d-4596-889b-5212ee05b3bb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1810 microversion: 2.20 time: 0.179591 Sep 12 23:56:23.348301 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 186/369] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:56:23 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1810 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 23:56:24.375309 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a33969b6-703b-4030-bf37-803b607385f9 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:24.376446 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a33969b6-703b-4030-bf37-803b607385f9 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:24.388420 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a33969b6-703b-4030-bf37-803b607385f9 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:24.389270 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a33969b6-703b-4030-bf37-803b607385f9 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:24.390002 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a33969b6-703b-4030-bf37-803b607385f9 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:24.391458 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a33969b6-703b-4030-bf37-803b607385f9 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:24.392304 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a33969b6-703b-4030-bf37-803b607385f9 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:24.392968 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a33969b6-703b-4030-bf37-803b607385f9 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:24.558028 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a33969b6-703b-4030-bf37-803b607385f9 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:24.567811 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a33969b6-703b-4030-bf37-803b607385f9 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:24.569247 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a33969b6-703b-4030-bf37-803b607385f9 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:24.570431 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a33969b6-703b-4030-bf37-803b607385f9 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1810 microversion: 2.20 time: 0.200002 Sep 12 23:56:24.575035 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 184/370] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:56:24 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1810 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:56:25.595953 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0e2b959f-a95b-4626-b7d6-8820f0da5463 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:25.596702 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0e2b959f-a95b-4626-b7d6-8820f0da5463 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:25.603869 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0e2b959f-a95b-4626-b7d6-8820f0da5463 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:25.604358 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0e2b959f-a95b-4626-b7d6-8820f0da5463 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:25.604791 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0e2b959f-a95b-4626-b7d6-8820f0da5463 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:25.605492 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0e2b959f-a95b-4626-b7d6-8820f0da5463 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:25.605942 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0e2b959f-a95b-4626-b7d6-8820f0da5463 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:25.606361 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0e2b959f-a95b-4626-b7d6-8820f0da5463 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:25.750854 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0e2b959f-a95b-4626-b7d6-8820f0da5463 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:25.760253 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0e2b959f-a95b-4626-b7d6-8820f0da5463 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:25.761670 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0e2b959f-a95b-4626-b7d6-8820f0da5463 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:25.762827 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0e2b959f-a95b-4626-b7d6-8820f0da5463 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1810 microversion: 2.20 time: 0.170996 Sep 12 23:56:25.763427 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 187/371] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:56:25 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1810 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:56:26.788643 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e42539e0-b21c-4c79-bcb2-cf25a18e57bb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:26.789401 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e42539e0-b21c-4c79-bcb2-cf25a18e57bb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:26.796074 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e42539e0-b21c-4c79-bcb2-cf25a18e57bb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:26.796555 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e42539e0-b21c-4c79-bcb2-cf25a18e57bb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:26.797046 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e42539e0-b21c-4c79-bcb2-cf25a18e57bb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:26.797763 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e42539e0-b21c-4c79-bcb2-cf25a18e57bb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:26.798906 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e42539e0-b21c-4c79-bcb2-cf25a18e57bb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:26.799477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e42539e0-b21c-4c79-bcb2-cf25a18e57bb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:27.099519 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e42539e0-b21c-4c79-bcb2-cf25a18e57bb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:27.110117 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e42539e0-b21c-4c79-bcb2-cf25a18e57bb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:27.111628 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e42539e0-b21c-4c79-bcb2-cf25a18e57bb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:27.113082 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e42539e0-b21c-4c79-bcb2-cf25a18e57bb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1810 microversion: 2.20 time: 0.328429 Sep 12 23:56:27.113459 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 185/372] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:56:26 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1810 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:56:28.139972 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3858b05b-d6d9-41c3-8d22-e6db1f44416b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:28.140543 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3858b05b-d6d9-41c3-8d22-e6db1f44416b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:28.147486 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3858b05b-d6d9-41c3-8d22-e6db1f44416b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:28.147975 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3858b05b-d6d9-41c3-8d22-e6db1f44416b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:28.148377 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3858b05b-d6d9-41c3-8d22-e6db1f44416b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:28.149100 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3858b05b-d6d9-41c3-8d22-e6db1f44416b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:28.149563 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3858b05b-d6d9-41c3-8d22-e6db1f44416b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:28.149968 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3858b05b-d6d9-41c3-8d22-e6db1f44416b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:28.290695 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3858b05b-d6d9-41c3-8d22-e6db1f44416b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:28.299585 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3858b05b-d6d9-41c3-8d22-e6db1f44416b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:28.301028 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3858b05b-d6d9-41c3-8d22-e6db1f44416b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:28.302193 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3858b05b-d6d9-41c3-8d22-e6db1f44416b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1810 microversion: 2.20 time: 0.166573 Sep 12 23:56:28.302801 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 188/373] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:56:28 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:56:29.328201 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ba3c8923-9b0d-4aaf-88b9-601c33d13c75 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:29.328804 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ba3c8923-9b0d-4aaf-88b9-601c33d13c75 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:29.335693 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ba3c8923-9b0d-4aaf-88b9-601c33d13c75 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:29.336199 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ba3c8923-9b0d-4aaf-88b9-601c33d13c75 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:29.336635 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ba3c8923-9b0d-4aaf-88b9-601c33d13c75 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:29.337330 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ba3c8923-9b0d-4aaf-88b9-601c33d13c75 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:29.337765 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ba3c8923-9b0d-4aaf-88b9-601c33d13c75 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:29.338186 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ba3c8923-9b0d-4aaf-88b9-601c33d13c75 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:29.484564 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ba3c8923-9b0d-4aaf-88b9-601c33d13c75 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:29.494957 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ba3c8923-9b0d-4aaf-88b9-601c33d13c75 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:29.496478 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ba3c8923-9b0d-4aaf-88b9-601c33d13c75 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:29.497646 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ba3c8923-9b0d-4aaf-88b9-601c33d13c75 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1810 microversion: 2.20 time: 0.173617 Sep 12 23:56:29.498193 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 186/374] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:56:29 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1810 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:56:30.526826 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b5520375-898b-4061-b6ba-b7d80466d4ab tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:30.527468 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b5520375-898b-4061-b6ba-b7d80466d4ab tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:30.536430 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b5520375-898b-4061-b6ba-b7d80466d4ab tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:30.536890 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b5520375-898b-4061-b6ba-b7d80466d4ab tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:30.537327 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b5520375-898b-4061-b6ba-b7d80466d4ab tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:30.538025 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b5520375-898b-4061-b6ba-b7d80466d4ab tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:30.538478 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b5520375-898b-4061-b6ba-b7d80466d4ab tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:30.538896 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b5520375-898b-4061-b6ba-b7d80466d4ab tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:30.678544 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b5520375-898b-4061-b6ba-b7d80466d4ab tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:30.688640 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b5520375-898b-4061-b6ba-b7d80466d4ab tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:30.690884 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b5520375-898b-4061-b6ba-b7d80466d4ab tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:30.692079 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b5520375-898b-4061-b6ba-b7d80466d4ab tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1810 microversion: 2.20 time: 0.171932 Sep 12 23:56:30.692614 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 189/375] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:56:30 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1810 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:56:31.717544 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d96676d4-527f-4551-a5fc-6fdec5f82d6c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:31.718175 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d96676d4-527f-4551-a5fc-6fdec5f82d6c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:31.725274 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d96676d4-527f-4551-a5fc-6fdec5f82d6c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:31.725931 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d96676d4-527f-4551-a5fc-6fdec5f82d6c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:31.726359 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d96676d4-527f-4551-a5fc-6fdec5f82d6c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:31.727136 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d96676d4-527f-4551-a5fc-6fdec5f82d6c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:31.727718 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d96676d4-527f-4551-a5fc-6fdec5f82d6c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:31.728290 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d96676d4-527f-4551-a5fc-6fdec5f82d6c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:31.865484 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d96676d4-527f-4551-a5fc-6fdec5f82d6c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:31.875395 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d96676d4-527f-4551-a5fc-6fdec5f82d6c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:31.877029 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d96676d4-527f-4551-a5fc-6fdec5f82d6c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:31.878339 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d96676d4-527f-4551-a5fc-6fdec5f82d6c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1810 microversion: 2.20 time: 0.164627 Sep 12 23:56:31.878910 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 187/376] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:56:31 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:56:32.916839 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-418e478c-3345-44e0-bc2b-19c346bd2975 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:32.917468 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-418e478c-3345-44e0-bc2b-19c346bd2975 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:32.924324 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-418e478c-3345-44e0-bc2b-19c346bd2975 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:32.924840 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-418e478c-3345-44e0-bc2b-19c346bd2975 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:32.925257 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-418e478c-3345-44e0-bc2b-19c346bd2975 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:32.925944 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-418e478c-3345-44e0-bc2b-19c346bd2975 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:32.926379 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-418e478c-3345-44e0-bc2b-19c346bd2975 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:32.926792 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-418e478c-3345-44e0-bc2b-19c346bd2975 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:33.077751 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-418e478c-3345-44e0-bc2b-19c346bd2975 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:33.087196 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-418e478c-3345-44e0-bc2b-19c346bd2975 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:33.088655 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-418e478c-3345-44e0-bc2b-19c346bd2975 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:33.089853 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-418e478c-3345-44e0-bc2b-19c346bd2975 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1810 microversion: 2.20 time: 0.177090 Sep 12 23:56:33.090675 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 190/377] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:56:32 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1810 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:56:34.122170 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7a5a31a6-048f-431f-ad0e-3012b3edad30 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:34.122981 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7a5a31a6-048f-431f-ad0e-3012b3edad30 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:34.130436 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7a5a31a6-048f-431f-ad0e-3012b3edad30 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:34.130994 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7a5a31a6-048f-431f-ad0e-3012b3edad30 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:34.131617 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7a5a31a6-048f-431f-ad0e-3012b3edad30 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:34.132478 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7a5a31a6-048f-431f-ad0e-3012b3edad30 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:34.133145 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7a5a31a6-048f-431f-ad0e-3012b3edad30 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:34.133678 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7a5a31a6-048f-431f-ad0e-3012b3edad30 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:34.278242 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7a5a31a6-048f-431f-ad0e-3012b3edad30 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:34.287745 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7a5a31a6-048f-431f-ad0e-3012b3edad30 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:34.289190 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7a5a31a6-048f-431f-ad0e-3012b3edad30 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:34.290356 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7a5a31a6-048f-431f-ad0e-3012b3edad30 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1810 microversion: 2.20 time: 0.173258 Sep 12 23:56:34.290885 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 188/378] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:56:34 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1810 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:56:35.316493 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-51db20fa-3d9c-435a-93de-a138a5e0bdb1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:35.317197 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-51db20fa-3d9c-435a-93de-a138a5e0bdb1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:35.325284 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-51db20fa-3d9c-435a-93de-a138a5e0bdb1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:35.325701 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-51db20fa-3d9c-435a-93de-a138a5e0bdb1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:35.326134 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-51db20fa-3d9c-435a-93de-a138a5e0bdb1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:35.326867 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-51db20fa-3d9c-435a-93de-a138a5e0bdb1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:35.327376 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-51db20fa-3d9c-435a-93de-a138a5e0bdb1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:35.327765 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-51db20fa-3d9c-435a-93de-a138a5e0bdb1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:35.488302 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-51db20fa-3d9c-435a-93de-a138a5e0bdb1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:35.504476 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-51db20fa-3d9c-435a-93de-a138a5e0bdb1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:35.507317 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-51db20fa-3d9c-435a-93de-a138a5e0bdb1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:35.508868 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-51db20fa-3d9c-435a-93de-a138a5e0bdb1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1810 microversion: 2.20 time: 0.196583 Sep 12 23:56:35.509471 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 191/379] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:56:35 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1810 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:56:36.535759 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-753af58c-74d9-4af2-8c02-c2f8c202dbee tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:36.536328 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-753af58c-74d9-4af2-8c02-c2f8c202dbee tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:36.543802 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-753af58c-74d9-4af2-8c02-c2f8c202dbee tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:36.544332 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-753af58c-74d9-4af2-8c02-c2f8c202dbee tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:36.544769 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-753af58c-74d9-4af2-8c02-c2f8c202dbee tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:36.545483 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-753af58c-74d9-4af2-8c02-c2f8c202dbee tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:36.545937 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-753af58c-74d9-4af2-8c02-c2f8c202dbee tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:36.546333 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-753af58c-74d9-4af2-8c02-c2f8c202dbee tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:36.690111 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-753af58c-74d9-4af2-8c02-c2f8c202dbee tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:36.702216 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-753af58c-74d9-4af2-8c02-c2f8c202dbee tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:36.704464 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-753af58c-74d9-4af2-8c02-c2f8c202dbee tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:36.706366 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-753af58c-74d9-4af2-8c02-c2f8c202dbee tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1810 microversion: 2.20 time: 0.174741 Sep 12 23:56:36.706938 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 189/380] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:56:36 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1810 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:56:37.293009 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-ad06d9a9-92bd-4160-8d2f-971a2f4fb16a req-d84e8b6e-84e1-4b1f-8d2d-7b2bbd1ec9b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "893ed869-802c-4a92-b7ab-d2aa8324fb65", "name": "network-vif-plugged", "status": "completed", "tag": "3a5cf7e7-3d44-4786-8d75-99e5d72ef0e0"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:56:37.304591 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-ad06d9a9-92bd-4160-8d2f-971a2f4fb16a req-d84e8b6e-84e1-4b1f-8d2d-7b2bbd1ec9b5 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:37.305098 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-ad06d9a9-92bd-4160-8d2f-971a2f4fb16a req-d84e8b6e-84e1-4b1f-8d2d-7b2bbd1ec9b5 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:37.305526 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-ad06d9a9-92bd-4160-8d2f-971a2f4fb16a req-d84e8b6e-84e1-4b1f-8d2d-7b2bbd1ec9b5 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:37.317100 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-ad06d9a9-92bd-4160-8d2f-971a2f4fb16a req-d84e8b6e-84e1-4b1f-8d2d-7b2bbd1ec9b5 service nova] Creating event network-vif-plugged:3a5cf7e7-3d44-4786-8d75-99e5d72ef0e0 for instance 893ed869-802c-4a92-b7ab-d2aa8324fb65 on hv-cinder-82002 Sep 12 23:56:37.322220 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-ad06d9a9-92bd-4160-8d2f-971a2f4fb16a req-d84e8b6e-84e1-4b1f-8d2d-7b2bbd1ec9b5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033295 Sep 12 23:56:37.323089 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 192/381] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:56:37.736976 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0ace8feb-05ff-400a-8f32-ccf1ecb7a060 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:37.738256 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0ace8feb-05ff-400a-8f32-ccf1ecb7a060 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:37.748950 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0ace8feb-05ff-400a-8f32-ccf1ecb7a060 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:37.749628 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0ace8feb-05ff-400a-8f32-ccf1ecb7a060 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:37.750206 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0ace8feb-05ff-400a-8f32-ccf1ecb7a060 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:37.751043 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0ace8feb-05ff-400a-8f32-ccf1ecb7a060 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:37.751630 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0ace8feb-05ff-400a-8f32-ccf1ecb7a060 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:37.752334 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0ace8feb-05ff-400a-8f32-ccf1ecb7a060 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:37.957734 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0ace8feb-05ff-400a-8f32-ccf1ecb7a060 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:37.967494 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0ace8feb-05ff-400a-8f32-ccf1ecb7a060 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:37.968939 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0ace8feb-05ff-400a-8f32-ccf1ecb7a060 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:37.970168 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0ace8feb-05ff-400a-8f32-ccf1ecb7a060 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1810 microversion: 2.20 time: 0.240950 Sep 12 23:56:37.970947 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 190/382] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:56:37 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1810 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:56:38.997846 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-af762c14-5f21-4425-9e3e-d9d639e7efc4 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:38.998549 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-af762c14-5f21-4425-9e3e-d9d639e7efc4 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:39.006934 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-af762c14-5f21-4425-9e3e-d9d639e7efc4 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:39.007545 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-af762c14-5f21-4425-9e3e-d9d639e7efc4 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:39.007983 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-af762c14-5f21-4425-9e3e-d9d639e7efc4 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:39.008718 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-af762c14-5f21-4425-9e3e-d9d639e7efc4 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:39.009176 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-af762c14-5f21-4425-9e3e-d9d639e7efc4 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:39.009653 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-af762c14-5f21-4425-9e3e-d9d639e7efc4 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:39.167330 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-af762c14-5f21-4425-9e3e-d9d639e7efc4 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:39.178875 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-af762c14-5f21-4425-9e3e-d9d639e7efc4 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:39.180370 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-af762c14-5f21-4425-9e3e-d9d639e7efc4 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:39.181642 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-af762c14-5f21-4425-9e3e-d9d639e7efc4 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1810 microversion: 2.20 time: 0.188778 Sep 12 23:56:39.182216 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 193/383] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:56:38 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1810 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:56:40.207530 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-863958bf-95fc-4069-ab79-807664d1a7b1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:40.208324 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-863958bf-95fc-4069-ab79-807664d1a7b1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:40.216630 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-863958bf-95fc-4069-ab79-807664d1a7b1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:40.217218 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-863958bf-95fc-4069-ab79-807664d1a7b1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:40.217772 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-863958bf-95fc-4069-ab79-807664d1a7b1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:40.218810 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-863958bf-95fc-4069-ab79-807664d1a7b1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:40.219783 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-863958bf-95fc-4069-ab79-807664d1a7b1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:40.220225 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-863958bf-95fc-4069-ab79-807664d1a7b1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:40.409479 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-863958bf-95fc-4069-ab79-807664d1a7b1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:40.421058 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-863958bf-95fc-4069-ab79-807664d1a7b1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:40.423146 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-863958bf-95fc-4069-ab79-807664d1a7b1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:40.424651 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-863958bf-95fc-4069-ab79-807664d1a7b1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1810 microversion: 2.20 time: 0.221239 Sep 12 23:56:40.425605 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 191/384] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:56:40 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1810 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:56:41.452018 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-853b1829-ef47-43b9-bad3-127ec04a28c1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:41.452593 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-853b1829-ef47-43b9-bad3-127ec04a28c1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:41.459428 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-853b1829-ef47-43b9-bad3-127ec04a28c1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:41.459911 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-853b1829-ef47-43b9-bad3-127ec04a28c1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:41.460337 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-853b1829-ef47-43b9-bad3-127ec04a28c1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:41.461019 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-853b1829-ef47-43b9-bad3-127ec04a28c1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:41.461472 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-853b1829-ef47-43b9-bad3-127ec04a28c1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:41.461911 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-853b1829-ef47-43b9-bad3-127ec04a28c1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:41.599578 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-853b1829-ef47-43b9-bad3-127ec04a28c1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:41.609131 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-853b1829-ef47-43b9-bad3-127ec04a28c1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:41.610563 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-853b1829-ef47-43b9-bad3-127ec04a28c1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:41.611745 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-853b1829-ef47-43b9-bad3-127ec04a28c1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1797 microversion: 2.20 time: 0.163991 Sep 12 23:56:41.612315 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 194/385] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:56:41 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1797 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:56:43.270193 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-56ecbbce-5a87-4814-8763-6eb7c7089e69 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:43.270193 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-56ecbbce-5a87-4814-8763-6eb7c7089e69 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:43.277296 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-56ecbbce-5a87-4814-8763-6eb7c7089e69 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:43.277783 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-56ecbbce-5a87-4814-8763-6eb7c7089e69 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:43.278207 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-56ecbbce-5a87-4814-8763-6eb7c7089e69 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:43.278905 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-56ecbbce-5a87-4814-8763-6eb7c7089e69 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:43.279382 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-56ecbbce-5a87-4814-8763-6eb7c7089e69 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:43.279784 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-56ecbbce-5a87-4814-8763-6eb7c7089e69 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:43.309166 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-56ecbbce-5a87-4814-8763-6eb7c7089e69 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c/ips" status: 200 len: 146 microversion: 2.1 time: 0.043242 Sep 12 23:56:43.310010 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 192/386] 10.222.0.26 () {58 vars in 1248 bytes} [Mon Sep 12 23:56:43 2022] GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c/ips => generated 146 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:56:45.597227 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-426b3919-ec6b-44f8-ae0e-7e96781f4e29 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23ee1ab9-4540-40bf-8815-9f773ac28599"}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:56:45.600206 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-426b3919-ec6b-44f8-ae0e-7e96781f4e29 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:45.607870 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-426b3919-ec6b-44f8-ae0e-7e96781f4e29 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:45.608376 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-426b3919-ec6b-44f8-ae0e-7e96781f4e29 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:45.608810 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-426b3919-ec6b-44f8-ae0e-7e96781f4e29 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:45.609543 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-426b3919-ec6b-44f8-ae0e-7e96781f4e29 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:45.610009 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-426b3919-ec6b-44f8-ae0e-7e96781f4e29 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:45.610439 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-426b3919-ec6b-44f8-ae0e-7e96781f4e29 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:45.613191 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=76 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:56:45.893847 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-426b3919-ec6b-44f8-ae0e-7e96781f4e29 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "POST /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.300539 Sep 12 23:56:45.894527 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 195/387] 10.222.0.26 () {60 vars in 1323 bytes} [Mon Sep 12 23:56:45 2022] POST /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c/os-volume_attachments => generated 194 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:56:48.606115 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5f64ae3c-cbd2-4136-9a4f-5dbaa9a041f1 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:56:48.608457 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5f64ae3c-cbd2-4136-9a4f-5dbaa9a041f1 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] [instance: c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:48.615574 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5f64ae3c-cbd2-4136-9a4f-5dbaa9a041f1 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:48.616061 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5f64ae3c-cbd2-4136-9a4f-5dbaa9a041f1 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:48.616521 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5f64ae3c-cbd2-4136-9a4f-5dbaa9a041f1 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:48.617215 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5f64ae3c-cbd2-4136-9a4f-5dbaa9a041f1 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:48.617667 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5f64ae3c-cbd2-4136-9a4f-5dbaa9a041f1 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:48.618086 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5f64ae3c-cbd2-4136-9a4f-5dbaa9a041f1 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:48.620663 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=76 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:56:48.704946 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5f64ae3c-cbd2-4136-9a4f-5dbaa9a041f1 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "POST /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a/action" status: 202 len: 0 microversion: 2.1 time: 0.102340 Sep 12 23:56:48.705763 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 193/388] 10.222.0.26 () {60 vars in 1278 bytes} [Mon Sep 12 23:56:48 2022] POST /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 23:56:48.715624 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-feb4c81d-1ec3-4f9b-8a7f-f308a834f2bd tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:48.716327 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-feb4c81d-1ec3-4f9b-8a7f-f308a834f2bd tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] [instance: c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:48.724151 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-feb4c81d-1ec3-4f9b-8a7f-f308a834f2bd tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:48.724745 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-feb4c81d-1ec3-4f9b-8a7f-f308a834f2bd tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:48.725171 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-feb4c81d-1ec3-4f9b-8a7f-f308a834f2bd tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:48.725868 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-feb4c81d-1ec3-4f9b-8a7f-f308a834f2bd tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:48.726308 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-feb4c81d-1ec3-4f9b-8a7f-f308a834f2bd tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:48.726726 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-feb4c81d-1ec3-4f9b-8a7f-f308a834f2bd tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:48.967204 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-feb4c81d-1ec3-4f9b-8a7f-f308a834f2bd tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76b3353ce4b4361872ed6dba9f895d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f7d1c88224ebd85d15f7c43e7fe72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:48.976644 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-feb4c81d-1ec3-4f9b-8a7f-f308a834f2bd tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a" status: 200 len: 1753 microversion: 2.1 time: 0.265729 Sep 12 23:56:48.977236 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 196/389] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:56:48 2022] GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a => generated 1753 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:56:50.001408 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6862c4ee-e650-455b-9bed-8287f4011d5b tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:50.002071 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6862c4ee-e650-455b-9bed-8287f4011d5b tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] [instance: c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:50.008951 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6862c4ee-e650-455b-9bed-8287f4011d5b tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:50.009432 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6862c4ee-e650-455b-9bed-8287f4011d5b tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:50.009824 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6862c4ee-e650-455b-9bed-8287f4011d5b tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:50.010529 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6862c4ee-e650-455b-9bed-8287f4011d5b tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:50.010974 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6862c4ee-e650-455b-9bed-8287f4011d5b tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:50.011419 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6862c4ee-e650-455b-9bed-8287f4011d5b tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:50.161634 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6862c4ee-e650-455b-9bed-8287f4011d5b tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76b3353ce4b4361872ed6dba9f895d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f7d1c88224ebd85d15f7c43e7fe72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:50.171693 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6862c4ee-e650-455b-9bed-8287f4011d5b tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a" status: 200 len: 1758 microversion: 2.1 time: 0.175318 Sep 12 23:56:50.187517 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 194/390] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:56:49 2022] GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a => generated 1758 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:56:51.196528 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-dd802194-1969-44fb-a331-4d51d82c26a4 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:51.197108 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-dd802194-1969-44fb-a331-4d51d82c26a4 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] [instance: c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:51.200762 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=24 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:56:51.205675 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dd802194-1969-44fb-a331-4d51d82c26a4 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:51.206419 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dd802194-1969-44fb-a331-4d51d82c26a4 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:51.206855 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dd802194-1969-44fb-a331-4d51d82c26a4 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:51.207585 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dd802194-1969-44fb-a331-4d51d82c26a4 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:51.208038 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dd802194-1969-44fb-a331-4d51d82c26a4 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:51.208452 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dd802194-1969-44fb-a331-4d51d82c26a4 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:51.369038 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-dd802194-1969-44fb-a331-4d51d82c26a4 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76b3353ce4b4361872ed6dba9f895d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f7d1c88224ebd85d15f7c43e7fe72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:51.381595 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-dd802194-1969-44fb-a331-4d51d82c26a4 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a" status: 200 len: 1758 microversion: 2.1 time: 0.188933 Sep 12 23:56:51.382403 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 197/391] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:56:51 2022] GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a => generated 1758 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:56:52.410396 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c087e781-b355-49eb-9b64-f4b14ab987b9 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:52.411034 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c087e781-b355-49eb-9b64-f4b14ab987b9 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] [instance: c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:52.413646 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=24 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:56:52.420056 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c087e781-b355-49eb-9b64-f4b14ab987b9 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:52.420535 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c087e781-b355-49eb-9b64-f4b14ab987b9 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:52.420960 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c087e781-b355-49eb-9b64-f4b14ab987b9 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:52.421690 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c087e781-b355-49eb-9b64-f4b14ab987b9 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:52.422168 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c087e781-b355-49eb-9b64-f4b14ab987b9 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:52.422570 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c087e781-b355-49eb-9b64-f4b14ab987b9 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:52.535720 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9217460e-107d-442e-be38-1f76ca10cc8a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:52.536143 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9217460e-107d-442e-be38-1f76ca10cc8a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: ad5faa90-b5ff-47e2-abab-21418459ecde] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:52.543550 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9217460e-107d-442e-be38-1f76ca10cc8a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:52.543927 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9217460e-107d-442e-be38-1f76ca10cc8a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:52.544568 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9217460e-107d-442e-be38-1f76ca10cc8a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:52.545456 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9217460e-107d-442e-be38-1f76ca10cc8a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:52.545908 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9217460e-107d-442e-be38-1f76ca10cc8a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:52.546319 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9217460e-107d-442e-be38-1f76ca10cc8a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:52.575496 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9217460e-107d-442e-be38-1f76ca10cc8a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde/ips" status: 200 len: 150 microversion: 2.1 time: 0.043600 Sep 12 23:56:52.576087 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 198/392] 10.222.0.26 () {58 vars in 1248 bytes} [Mon Sep 12 23:56:52 2022] GET /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 23:56:52.588686 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c087e781-b355-49eb-9b64-f4b14ab987b9 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76b3353ce4b4361872ed6dba9f895d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f7d1c88224ebd85d15f7c43e7fe72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:52.589276 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a09cbb09-eefe-481b-9097-1e005150b740 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "059d0261-28d7-4667-809e-0808cdc7047d"}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:56:52.591926 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a09cbb09-eefe-481b-9097-1e005150b740 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: ad5faa90-b5ff-47e2-abab-21418459ecde] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:52.598436 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a09cbb09-eefe-481b-9097-1e005150b740 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:52.598938 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a09cbb09-eefe-481b-9097-1e005150b740 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:52.600003 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a09cbb09-eefe-481b-9097-1e005150b740 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:52.600898 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a09cbb09-eefe-481b-9097-1e005150b740 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:52.601511 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a09cbb09-eefe-481b-9097-1e005150b740 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:52.602188 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a09cbb09-eefe-481b-9097-1e005150b740 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:52.606567 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c087e781-b355-49eb-9b64-f4b14ab987b9 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a" status: 200 len: 1758 microversion: 2.1 time: 0.199420 Sep 12 23:56:52.609413 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 195/393] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:56:52 2022] GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a => generated 1758 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:56:52.687864 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-a09cbb09-eefe-481b-9097-1e005150b740 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] HTTP exception thrown: Invalid volume: volume 059d0261-28d7-4667-809e-0808cdc7047d is already attached to instances: 1bdd77eb-4b69-4630-9f49-a1d317bb1e12 Sep 12 23:56:52.689612 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a09cbb09-eefe-481b-9097-1e005150b740 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Request method failure captured: Sep 12 23:56:52.689612 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: request: POST /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde/os-volume_attachments HTTP/1.1 Sep 12 23:56:52.689612 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept: application/json Sep 12 23:56:52.689612 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Sep 12 23:56:52.689612 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Connection: close Sep 12 23:56:52.689612 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Length: 74 Sep 12 23:56:52.689612 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Type: application/json Sep 12 23:56:52.689612 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Host: 10.222.0.26 Sep 12 23:56:52.689612 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Sep 12 23:56:52.689612 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Sep 12 23:56:52.689612 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjH8Z2hSl_dF3G_DVeQeMffC839mjKCX1ldHy7KYxwLbzxfI-Hnili9xft2wG7WgRYfuNYC0jIjSduHyiAWMPed8uo_fiAxdNKw8dFJEFK0lHOKo1_8VeXMUxxHgYF50XY0v_lkkNk_ejqmvpqtZKiNqfO8LXenu9zNmJy4upaAKztdpU Sep 12 23:56:52.689612 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Sep 12 23:56:52.689612 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Sep 12 23:56:52.689612 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Sep 12 23:56:52.689612 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Sep 12 23:56:52.689612 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Sep 12 23:56:52.689612 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Sep 12 23:56:52.689612 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Id: 6c681f1232de4a5fbfc728c230f80624 Sep 12 23:56:52.689612 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-AttachVolumeNegativeTest-1965954712 Sep 12 23:56:52.689612 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Role: member,reader Sep 12 23:56:52.689612 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Roles: member,reader Sep 12 23:56:52.691188 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6c681f1232de4a5fbfc728c230f80624"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6c681f1232de4a5fbfc728c230f80624"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6c681f1232de4a5fbfc728c230f80624"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6c681f1232de4a5fbfc728c230f80624"}]}] Sep 12 23:56:52.691188 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-AttachVolumeNegativeTest-1965954712 Sep 12 23:56:52.691188 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Id: 6c681f1232de4a5fbfc728c230f80624 Sep 12 23:56:52.691188 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1965954712 Sep 12 23:56:52.691188 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User: tempest-AttachVolumeNegativeTest-1965954712-project Sep 12 23:56:52.691188 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Sep 12 23:56:52.691188 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Sep 12 23:56:52.691188 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Id: a8cbfc74644f4d4594a70b833ad7002c Sep 12 23:56:52.691188 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-AttachVolumeNegativeTest-1965954712-project Sep 12 23:56:52.691188 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Sep 12 23:56:52.691188 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: {"volumeAttachment": {"volumeId": "059d0261-28d7-4667-809e-0808cdc7047d"}} Sep 12 23:56:52.691188 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: method: > Sep 12 23:56:52.692271 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: exception: Invalid volume: volume 059d0261-28d7-4667-809e-0808cdc7047d is already attached to instances: 1bdd77eb-4b69-4630-9f49-a1d317bb1e12 Sep 12 23:56:52.692271 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: action_args: {'server_id': 'ad5faa90-b5ff-47e2-abab-21418459ecde', 'body': {'volumeAttachment': {'volumeId': '059d0261-28d7-4667-809e-0808cdc7047d'}}} Sep 12 23:56:52.692271 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:56:52.692271 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:56:52.692271 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 12 23:56:52.692271 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 12 23:56:52.692271 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 12 23:56:52.692271 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 12 23:56:52.692271 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 12 23:56:52.692271 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 12 23:56:52.692271 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 12 23:56:52.692271 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 12 23:56:52.692271 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 12 23:56:52.692271 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 12 23:56:52.692271 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 059d0261-28d7-4667-809e-0808cdc7047d is already attached to instances: 1bdd77eb-4b69-4630-9f49-a1d317bb1e12 Sep 12 23:56:52.692271 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:56:52.692271 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:56:52.692271 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:56:52.692271 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:56:52.693720 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:56:52.693720 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:56:52.693720 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:56:52.693720 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:56:52.693720 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:56:52.693720 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:56:52.693720 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 12 23:56:52.693720 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 12 23:56:52.693720 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 12 23:56:52.693720 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 12 23:56:52.693720 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 12 23:56:52.693720 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 12 23:56:52.693720 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 12 23:56:52.693720 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 12 23:56:52.693720 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 059d0261-28d7-4667-809e-0808cdc7047d is already attached to instances: 1bdd77eb-4b69-4630-9f49-a1d317bb1e12 Sep 12 23:56:52.693720 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:56:52.693720 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:56:52.693720 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:56:52.693720 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:56:52.693720 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:56:52.694891 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:56:52.694891 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:56:52.694891 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:56:52.694891 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 059d0261-28d7-4667-809e-0808cdc7047d is already attached to instances: 1bdd77eb-4b69-4630-9f49-a1d317bb1e12 Sep 12 23:56:52.694891 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:56:52.694891 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a09cbb09-eefe-481b-9097-1e005150b740 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Returning 400 to user: Invalid volume: volume 059d0261-28d7-4667-809e-0808cdc7047d is already attached to instances: 1bdd77eb-4b69-4630-9f49-a1d317bb1e12 {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:56:52.694891 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a09cbb09-eefe-481b-9097-1e005150b740 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "POST /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106566 Sep 12 23:56:52.694891 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 199/394] 10.222.0.26 () {60 vars in 1323 bytes} [Mon Sep 12 23:56:52 2022] POST /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 12 23:56:52.701415 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-920d82a9-fa0b-42e6-908a-691a1d8140cb tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:52.702033 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-920d82a9-fa0b-42e6-908a-691a1d8140cb tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: ad5faa90-b5ff-47e2-abab-21418459ecde] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:52.708800 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-920d82a9-fa0b-42e6-908a-691a1d8140cb tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:52.709296 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-920d82a9-fa0b-42e6-908a-691a1d8140cb tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:52.709732 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-920d82a9-fa0b-42e6-908a-691a1d8140cb tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:52.710439 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-920d82a9-fa0b-42e6-908a-691a1d8140cb tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:52.710896 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-920d82a9-fa0b-42e6-908a-691a1d8140cb tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:52.711351 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-920d82a9-fa0b-42e6-908a-691a1d8140cb tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:52.740324 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-920d82a9-fa0b-42e6-908a-691a1d8140cb tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: ad5faa90-b5ff-47e2-abab-21418459ecde] Going to try to terminate instance {{(pid=126976) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 23:56:52.828733 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-920d82a9-fa0b-42e6-908a-691a1d8140cb tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde" status: 204 len: 0 microversion: 2.1 time: 0.131142 Sep 12 23:56:52.829446 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 196/395] 10.222.0.26 () {58 vars in 1239 bytes} [Mon Sep 12 23:56:52 2022] DELETE /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 12 23:56:52.838375 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1198b362-15d5-479f-9eb7-2f79e67b0ece tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:52.838987 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1198b362-15d5-479f-9eb7-2f79e67b0ece tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: ad5faa90-b5ff-47e2-abab-21418459ecde] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:52.846138 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1198b362-15d5-479f-9eb7-2f79e67b0ece tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:52.846626 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1198b362-15d5-479f-9eb7-2f79e67b0ece tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:52.847055 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1198b362-15d5-479f-9eb7-2f79e67b0ece tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:52.847781 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1198b362-15d5-479f-9eb7-2f79e67b0ece tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:52.848233 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1198b362-15d5-479f-9eb7-2f79e67b0ece tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:52.848657 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1198b362-15d5-479f-9eb7-2f79e67b0ece tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:52.997140 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-1198b362-15d5-479f-9eb7-2f79e67b0ece tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:53.009952 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1198b362-15d5-479f-9eb7-2f79e67b0ece tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde" status: 200 len: 1682 microversion: 2.1 time: 0.175449 Sep 12 23:56:53.010642 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 200/396] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:56:52 2022] GET /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde => generated 1682 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:56:53.490036 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0a87642e-a068-48d4-b574-ad15940d859e tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:56:53.497007 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0a87642e-a068-48d4-b574-ad15940d859e tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:53.497605 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0a87642e-a068-48d4-b574-ad15940d859e tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:53.498021 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0a87642e-a068-48d4-b574-ad15940d859e tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:53.569083 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0a87642e-a068-48d4-b574-ad15940d859e tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Going to try to stop instance {{(pid=126976) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 12 23:56:53.622623 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0a87642e-a068-48d4-b574-ad15940d859e tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "POST /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c/action" status: 202 len: 0 microversion: 2.1 time: 0.136581 Sep 12 23:56:53.623180 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 197/397] 10.222.0.26 () {60 vars in 1278 bytes} [Mon Sep 12 23:56:53 2022] POST /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 23:56:53.631548 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ebdd9b3e-31f8-4ff8-a6f8-bbecc814f18d tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:53.632165 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ebdd9b3e-31f8-4ff8-a6f8-bbecc814f18d tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:53.638737 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-33a0bdb2-86fd-4a44-ba65-59596a2c69d3 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:53.639445 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-33a0bdb2-86fd-4a44-ba65-59596a2c69d3 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] [instance: c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:53.640505 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ebdd9b3e-31f8-4ff8-a6f8-bbecc814f18d tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:53.641003 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ebdd9b3e-31f8-4ff8-a6f8-bbecc814f18d tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:53.641444 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ebdd9b3e-31f8-4ff8-a6f8-bbecc814f18d tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:53.642227 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ebdd9b3e-31f8-4ff8-a6f8-bbecc814f18d tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:53.642641 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ebdd9b3e-31f8-4ff8-a6f8-bbecc814f18d tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:53.643047 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ebdd9b3e-31f8-4ff8-a6f8-bbecc814f18d tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:53.645831 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-33a0bdb2-86fd-4a44-ba65-59596a2c69d3 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:53.646318 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-33a0bdb2-86fd-4a44-ba65-59596a2c69d3 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:53.646879 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-33a0bdb2-86fd-4a44-ba65-59596a2c69d3 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:53.647611 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-33a0bdb2-86fd-4a44-ba65-59596a2c69d3 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:53.648059 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-33a0bdb2-86fd-4a44-ba65-59596a2c69d3 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:53.648562 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-33a0bdb2-86fd-4a44-ba65-59596a2c69d3 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:53.860213 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ebdd9b3e-31f8-4ff8-a6f8-bbecc814f18d tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:53.869934 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-33a0bdb2-86fd-4a44-ba65-59596a2c69d3 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76b3353ce4b4361872ed6dba9f895d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f7d1c88224ebd85d15f7c43e7fe72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:53.870155 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ebdd9b3e-31f8-4ff8-a6f8-bbecc814f18d tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c" status: 200 len: 1722 microversion: 2.1 time: 0.242367 Sep 12 23:56:53.870636 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 201/398] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:56:53 2022] GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:56:53.878770 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-33a0bdb2-86fd-4a44-ba65-59596a2c69d3 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a" status: 200 len: 1758 microversion: 2.1 time: 0.244158 Sep 12 23:56:53.879258 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 198/399] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:56:53 2022] GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a => generated 1758 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:56:54.038689 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b4f81988-ba61-4f89-8912-9c7ff4819183 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:54.039321 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b4f81988-ba61-4f89-8912-9c7ff4819183 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: ad5faa90-b5ff-47e2-abab-21418459ecde] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:54.045989 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b4f81988-ba61-4f89-8912-9c7ff4819183 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:54.046478 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b4f81988-ba61-4f89-8912-9c7ff4819183 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:54.046918 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b4f81988-ba61-4f89-8912-9c7ff4819183 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:54.047644 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b4f81988-ba61-4f89-8912-9c7ff4819183 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:54.048101 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b4f81988-ba61-4f89-8912-9c7ff4819183 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:54.048521 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b4f81988-ba61-4f89-8912-9c7ff4819183 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:54.187197 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b4f81988-ba61-4f89-8912-9c7ff4819183 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:54.195477 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b4f81988-ba61-4f89-8912-9c7ff4819183 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde" status: 200 len: 1682 microversion: 2.1 time: 0.160939 Sep 12 23:56:54.196044 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 202/400] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:56:54 2022] GET /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:56:54.901387 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4734c33e-2f9a-47c4-b208-5d1bcf2ca7a6 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:54.902005 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-4734c33e-2f9a-47c4-b208-5d1bcf2ca7a6 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:54.902429 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f327041a-a0a8-4189-94d7-6e422d7fbdfa tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:54.903757 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f327041a-a0a8-4189-94d7-6e422d7fbdfa tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] [instance: c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:54.910724 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f327041a-a0a8-4189-94d7-6e422d7fbdfa tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:54.911539 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f327041a-a0a8-4189-94d7-6e422d7fbdfa tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:54.911818 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4734c33e-2f9a-47c4-b208-5d1bcf2ca7a6 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:54.911949 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f327041a-a0a8-4189-94d7-6e422d7fbdfa tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:54.912294 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4734c33e-2f9a-47c4-b208-5d1bcf2ca7a6 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:54.912668 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f327041a-a0a8-4189-94d7-6e422d7fbdfa tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:54.912772 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4734c33e-2f9a-47c4-b208-5d1bcf2ca7a6 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:54.913404 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f327041a-a0a8-4189-94d7-6e422d7fbdfa tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:54.913559 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4734c33e-2f9a-47c4-b208-5d1bcf2ca7a6 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:54.913838 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f327041a-a0a8-4189-94d7-6e422d7fbdfa tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:54.913966 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4734c33e-2f9a-47c4-b208-5d1bcf2ca7a6 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:54.914305 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4734c33e-2f9a-47c4-b208-5d1bcf2ca7a6 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:55.237156 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4734c33e-2f9a-47c4-b208-5d1bcf2ca7a6 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:55.245643 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-4734c33e-2f9a-47c4-b208-5d1bcf2ca7a6 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c" status: 200 len: 1722 microversion: 2.1 time: 0.348637 Sep 12 23:56:55.246220 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 199/401] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:56:54 2022] GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c => generated 1722 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:56:55.250833 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6e53c046-8197-4a88-a30c-baa97a999540 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:55.251468 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6e53c046-8197-4a88-a30c-baa97a999540 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: ad5faa90-b5ff-47e2-abab-21418459ecde] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:55.257427 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6e53c046-8197-4a88-a30c-baa97a999540 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:55.257912 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6e53c046-8197-4a88-a30c-baa97a999540 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:55.258353 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6e53c046-8197-4a88-a30c-baa97a999540 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:55.259055 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6e53c046-8197-4a88-a30c-baa97a999540 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:55.259637 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6e53c046-8197-4a88-a30c-baa97a999540 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:55.260055 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6e53c046-8197-4a88-a30c-baa97a999540 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:55.279965 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f327041a-a0a8-4189-94d7-6e422d7fbdfa tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76b3353ce4b4361872ed6dba9f895d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f7d1c88224ebd85d15f7c43e7fe72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:55.288997 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f327041a-a0a8-4189-94d7-6e422d7fbdfa tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a" status: 200 len: 1758 microversion: 2.1 time: 0.390738 Sep 12 23:56:55.289567 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 203/402] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:56:54 2022] GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a => generated 1758 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:56:55.502100 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6e53c046-8197-4a88-a30c-baa97a999540 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:55.512380 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6e53c046-8197-4a88-a30c-baa97a999540 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde" status: 200 len: 1682 microversion: 2.1 time: 0.264711 Sep 12 23:56:55.514093 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 200/403] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:56:55 2022] GET /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde => generated 1682 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:56:56.238576 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-fe6bbf0e-aa99-4d49-92a2-6615d17f9a79 req-df2ba910-2ba8-418b-852b-433df38be9ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad5faa90-b5ff-47e2-abab-21418459ecde", "name": "network-vif-deleted", "tag": "81ec905f-b1b8-4515-bb0c-1bc37b74e48f"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:56:56.250227 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-fe6bbf0e-aa99-4d49-92a2-6615d17f9a79 req-df2ba910-2ba8-418b-852b-433df38be9ab service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:56.251154 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-fe6bbf0e-aa99-4d49-92a2-6615d17f9a79 req-df2ba910-2ba8-418b-852b-433df38be9ab service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:56.251678 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-fe6bbf0e-aa99-4d49-92a2-6615d17f9a79 req-df2ba910-2ba8-418b-852b-433df38be9ab service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:56.268859 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-15a9265f-caa6-41f1-b2b1-1606f7f41efe tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:56.270655 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-15a9265f-caa6-41f1-b2b1-1606f7f41efe tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:56.277169 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-fe6bbf0e-aa99-4d49-92a2-6615d17f9a79 req-df2ba910-2ba8-418b-852b-433df38be9ab service nova] Creating event network-vif-deleted:81ec905f-b1b8-4515-bb0c-1bc37b74e48f for instance ad5faa90-b5ff-47e2-abab-21418459ecde on hv-cinder-82002 Sep 12 23:56:56.281523 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-15a9265f-caa6-41f1-b2b1-1606f7f41efe tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:56.283437 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-15a9265f-caa6-41f1-b2b1-1606f7f41efe tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:56.285336 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-15a9265f-caa6-41f1-b2b1-1606f7f41efe tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:56.286370 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-fe6bbf0e-aa99-4d49-92a2-6615d17f9a79 req-df2ba910-2ba8-418b-852b-433df38be9ab service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051365 Sep 12 23:56:56.287652 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-15a9265f-caa6-41f1-b2b1-1606f7f41efe tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:56.288992 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-15a9265f-caa6-41f1-b2b1-1606f7f41efe tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:56.292228 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 204/404] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:56:56.301795 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-15a9265f-caa6-41f1-b2b1-1606f7f41efe tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:56.319596 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d245fb1d-649c-4fd1-ab50-6a19987e81c8 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:56.321328 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d245fb1d-649c-4fd1-ab50-6a19987e81c8 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] [instance: c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:56.334725 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d245fb1d-649c-4fd1-ab50-6a19987e81c8 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:56.336157 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d245fb1d-649c-4fd1-ab50-6a19987e81c8 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:56.337175 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d245fb1d-649c-4fd1-ab50-6a19987e81c8 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:56.338938 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d245fb1d-649c-4fd1-ab50-6a19987e81c8 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:56.340109 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d245fb1d-649c-4fd1-ab50-6a19987e81c8 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:56.341175 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d245fb1d-649c-4fd1-ab50-6a19987e81c8 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:56.548122 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-15a9265f-caa6-41f1-b2b1-1606f7f41efe tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:56.560603 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-15a9265f-caa6-41f1-b2b1-1606f7f41efe tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c" status: 200 len: 1722 microversion: 2.1 time: 0.294671 Sep 12 23:56:56.580656 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 201/405] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:56:56 2022] GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c => generated 1722 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:56:56.597361 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-291934b6-585c-4224-8824-9f30e683c62c tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:56.598117 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-291934b6-585c-4224-8824-9f30e683c62c tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: ad5faa90-b5ff-47e2-abab-21418459ecde] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:56.600936 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d245fb1d-649c-4fd1-ab50-6a19987e81c8 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76b3353ce4b4361872ed6dba9f895d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f7d1c88224ebd85d15f7c43e7fe72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:56.607084 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-291934b6-585c-4224-8824-9f30e683c62c tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:56.608224 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-291934b6-585c-4224-8824-9f30e683c62c tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:56.609739 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-291934b6-585c-4224-8824-9f30e683c62c tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:56.610709 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-291934b6-585c-4224-8824-9f30e683c62c tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:56.610835 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d245fb1d-649c-4fd1-ab50-6a19987e81c8 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a" status: 200 len: 1758 microversion: 2.1 time: 0.300576 Sep 12 23:56:56.611750 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 205/406] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:56:56 2022] GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a => generated 1758 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:56:56.612371 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-291934b6-585c-4224-8824-9f30e683c62c tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:56.613039 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-291934b6-585c-4224-8824-9f30e683c62c tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:56.657367 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-291934b6-585c-4224-8824-9f30e683c62c tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:56.658282 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-291934b6-585c-4224-8824-9f30e683c62c tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:56.658833 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-291934b6-585c-4224-8824-9f30e683c62c tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:56.659639 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.objects.instance [None req-291934b6-585c-4224-8824-9f30e683c62c tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lazy-loading 'fault' on Instance uuid ad5faa90-b5ff-47e2-abab-21418459ecde {{(pid=126976) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 23:56:56.710556 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-291934b6-585c-4224-8824-9f30e683c62c tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:56.720585 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-291934b6-585c-4224-8824-9f30e683c62c tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde" status: 200 len: 1332 microversion: 2.1 time: 0.137598 Sep 12 23:56:56.721187 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 202/407] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:56:56 2022] GET /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde => generated 1332 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:56:57.590170 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5c6f3c38-b82b-4c0b-b406-a7bd1a3244b3 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:57.591170 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5c6f3c38-b82b-4c0b-b406-a7bd1a3244b3 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:57.599635 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5c6f3c38-b82b-4c0b-b406-a7bd1a3244b3 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:57.600111 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5c6f3c38-b82b-4c0b-b406-a7bd1a3244b3 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:57.600598 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5c6f3c38-b82b-4c0b-b406-a7bd1a3244b3 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:57.601555 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5c6f3c38-b82b-4c0b-b406-a7bd1a3244b3 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:57.602180 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5c6f3c38-b82b-4c0b-b406-a7bd1a3244b3 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:57.602862 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5c6f3c38-b82b-4c0b-b406-a7bd1a3244b3 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:57.635600 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3eec9b15-761c-4594-8735-214f5018ea4d tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:57.636229 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3eec9b15-761c-4594-8735-214f5018ea4d tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] [instance: c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:57.644628 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3eec9b15-761c-4594-8735-214f5018ea4d tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:57.645112 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3eec9b15-761c-4594-8735-214f5018ea4d tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:57.645543 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3eec9b15-761c-4594-8735-214f5018ea4d tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:57.646244 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3eec9b15-761c-4594-8735-214f5018ea4d tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:57.646699 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3eec9b15-761c-4594-8735-214f5018ea4d tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:57.647114 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3eec9b15-761c-4594-8735-214f5018ea4d tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:57.803195 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5c6f3c38-b82b-4c0b-b406-a7bd1a3244b3 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:57.812093 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5c6f3c38-b82b-4c0b-b406-a7bd1a3244b3 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c" status: 200 len: 1722 microversion: 2.1 time: 0.226810 Sep 12 23:56:57.812683 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 206/408] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:56:57 2022] GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:56:57.817901 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3bee8e77-5c89-4e5f-9bbb-aa1e23179fc1 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:57.818818 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3bee8e77-5c89-4e5f-9bbb-aa1e23179fc1 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: ad5faa90-b5ff-47e2-abab-21418459ecde] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:57.825550 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3bee8e77-5c89-4e5f-9bbb-aa1e23179fc1 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:57.826345 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3bee8e77-5c89-4e5f-9bbb-aa1e23179fc1 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:57.826957 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3bee8e77-5c89-4e5f-9bbb-aa1e23179fc1 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:57.828050 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3bee8e77-5c89-4e5f-9bbb-aa1e23179fc1 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:57.828684 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3bee8e77-5c89-4e5f-9bbb-aa1e23179fc1 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:57.829392 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3bee8e77-5c89-4e5f-9bbb-aa1e23179fc1 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:57.843711 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-3bee8e77-5c89-4e5f-9bbb-aa1e23179fc1 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] HTTP exception thrown: Instance ad5faa90-b5ff-47e2-abab-21418459ecde could not be found. Sep 12 23:56:57.845379 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3bee8e77-5c89-4e5f-9bbb-aa1e23179fc1 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Request method failure captured: Sep 12 23:56:57.845379 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: request: GET /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde HTTP/1.1 Sep 12 23:56:57.845379 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept: application/json Sep 12 23:56:57.845379 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Sep 12 23:56:57.845379 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Connection: close Sep 12 23:56:57.845379 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Length: 0 Sep 12 23:56:57.845379 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Type: application/json Sep 12 23:56:57.845379 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Host: 10.222.0.26 Sep 12 23:56:57.845379 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Sep 12 23:56:57.845379 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Sep 12 23:56:57.845379 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjH8Z2hSl_dF3G_DVeQeMffC839mjKCX1ldHy7KYxwLbzxfI-Hnili9xft2wG7WgRYfuNYC0jIjSduHyiAWMPed8uo_fiAxdNKw8dFJEFK0lHOKo1_8VeXMUxxHgYF50XY0v_lkkNk_ejqmvpqtZKiNqfO8LXenu9zNmJy4upaAKztdpU Sep 12 23:56:57.845379 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Sep 12 23:56:57.845379 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Sep 12 23:56:57.845379 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Sep 12 23:56:57.845379 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Sep 12 23:56:57.845379 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Sep 12 23:56:57.845379 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Sep 12 23:56:57.845379 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Id: 6c681f1232de4a5fbfc728c230f80624 Sep 12 23:56:57.845379 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-AttachVolumeNegativeTest-1965954712 Sep 12 23:56:57.845379 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Role: member,reader Sep 12 23:56:57.845379 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Roles: member,reader Sep 12 23:56:57.846841 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6c681f1232de4a5fbfc728c230f80624"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6c681f1232de4a5fbfc728c230f80624"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6c681f1232de4a5fbfc728c230f80624"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6c681f1232de4a5fbfc728c230f80624"}]}] Sep 12 23:56:57.846841 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-AttachVolumeNegativeTest-1965954712 Sep 12 23:56:57.846841 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Id: 6c681f1232de4a5fbfc728c230f80624 Sep 12 23:56:57.846841 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1965954712 Sep 12 23:56:57.846841 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User: tempest-AttachVolumeNegativeTest-1965954712-project Sep 12 23:56:57.846841 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Sep 12 23:56:57.846841 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Sep 12 23:56:57.846841 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Id: a8cbfc74644f4d4594a70b833ad7002c Sep 12 23:56:57.846841 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-AttachVolumeNegativeTest-1965954712-project Sep 12 23:56:57.846841 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: method: > Sep 12 23:56:57.846841 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: exception: Instance ad5faa90-b5ff-47e2-abab-21418459ecde could not be found. Sep 12 23:56:57.846841 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: action_args: {'id': 'ad5faa90-b5ff-47e2-abab-21418459ecde'} Sep 12 23:56:57.847613 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:56:57.847613 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:56:57.847613 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:56:57.847613 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:56:57.847613 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:56:57.847613 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:56:57.847613 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:56:57.847613 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:56:57.847613 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:56:57.847613 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:56:57.847613 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad5faa90-b5ff-47e2-abab-21418459ecde could not be found. Sep 12 23:56:57.847613 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:56:57.847613 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:56:57.847613 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:56:57.847613 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:56:57.847613 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:56:57.847613 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:56:57.847613 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:56:57.847613 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:56:57.847613 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:56:57.848857 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:56:57.848857 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 23:56:57.848857 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 23:56:57.848857 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:56:57.848857 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:56:57.848857 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:56:57.848857 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:56:57.848857 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad5faa90-b5ff-47e2-abab-21418459ecde could not be found. Sep 12 23:56:57.848857 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:56:57.848857 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:56:57.848857 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:56:57.848857 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:56:57.848857 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:56:57.848857 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:56:57.848857 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:56:57.848857 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:56:57.848857 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad5faa90-b5ff-47e2-abab-21418459ecde could not be found. Sep 12 23:56:57.848857 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:56:57.850007 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3bee8e77-5c89-4e5f-9bbb-aa1e23179fc1 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Returning 404 to user: Instance ad5faa90-b5ff-47e2-abab-21418459ecde could not be found. {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:56:57.850007 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3bee8e77-5c89-4e5f-9bbb-aa1e23179fc1 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde" status: 404 len: 111 microversion: 2.1 time: 0.033167 Sep 12 23:56:57.850007 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 207/409] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:56:57 2022] GET /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:56:57.851329 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3eec9b15-761c-4594-8735-214f5018ea4d tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76b3353ce4b4361872ed6dba9f895d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f7d1c88224ebd85d15f7c43e7fe72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:57.855709 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-edf6eadd-09e5-4cc6-ae48-2e5e2dc58e50 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '.version_select at 0x7fed0151c9d0>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:57.857721 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3eec9b15-761c-4594-8735-214f5018ea4d tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a" status: 200 len: 1758 microversion: 2.1 time: 0.226365 Sep 12 23:56:57.858616 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 203/410] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:56:57 2022] GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a => generated 1758 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:56:57.881923 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-edf6eadd-09e5-4cc6-ae48-2e5e2dc58e50 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2034339834" status: 202 len: 0 microversion: 2.1 time: 0.029666 Sep 12 23:56:57.884642 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 208/411] 10.222.0.26 () {58 vars in 1221 bytes} [Mon Sep 12 23:56:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2034339834 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 23:56:58.626865 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-31293e23-dba1-44b9-b74d-aca7ac95f949 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:58.627388 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-31293e23-dba1-44b9-b74d-aca7ac95f949 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: 1bdd77eb-4b69-4630-9f49-a1d317bb1e12] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:58.633523 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-31293e23-dba1-44b9-b74d-aca7ac95f949 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:58.633996 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-31293e23-dba1-44b9-b74d-aca7ac95f949 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:58.634422 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-31293e23-dba1-44b9-b74d-aca7ac95f949 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:58.635107 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-31293e23-dba1-44b9-b74d-aca7ac95f949 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:58.635571 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-31293e23-dba1-44b9-b74d-aca7ac95f949 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:58.635979 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-31293e23-dba1-44b9-b74d-aca7ac95f949 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:58.768588 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.objects.instance [None req-31293e23-dba1-44b9-b74d-aca7ac95f949 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lazy-loading 'services' on Instance uuid 1bdd77eb-4b69-4630-9f49-a1d317bb1e12 {{(pid=126976) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 23:56:58.837106 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-443168b7-1db3-43c0-9436-2ccf9ec62e35 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:58.837784 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-443168b7-1db3-43c0-9436-2ccf9ec62e35 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:58.845214 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-443168b7-1db3-43c0-9436-2ccf9ec62e35 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:58.845707 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-443168b7-1db3-43c0-9436-2ccf9ec62e35 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:58.846191 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-443168b7-1db3-43c0-9436-2ccf9ec62e35 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:58.846908 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-443168b7-1db3-43c0-9436-2ccf9ec62e35 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:58.847387 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-443168b7-1db3-43c0-9436-2ccf9ec62e35 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:58.847813 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-443168b7-1db3-43c0-9436-2ccf9ec62e35 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:58.903254 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-31293e23-dba1-44b9-b74d-aca7ac95f949 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12/os-volume_attachments/059d0261-28d7-4667-809e-0808cdc7047d" status: 202 len: 0 microversion: 2.1 time: 0.279933 Sep 12 23:56:58.907015 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 204/412] 10.222.0.26 () {58 vars in 1416 bytes} [Mon Sep 12 23:56:58 2022] DELETE /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12/os-volume_attachments/059d0261-28d7-4667-809e-0808cdc7047d => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 23:56:58.909920 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-bbf0ca3c-7dce-4787-ab3f-0b3f175cf655 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:58.910883 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-bbf0ca3c-7dce-4787-ab3f-0b3f175cf655 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] [instance: c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:58.917519 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bbf0ca3c-7dce-4787-ab3f-0b3f175cf655 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:58.918230 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bbf0ca3c-7dce-4787-ab3f-0b3f175cf655 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:58.918663 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bbf0ca3c-7dce-4787-ab3f-0b3f175cf655 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:58.919394 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bbf0ca3c-7dce-4787-ab3f-0b3f175cf655 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:58.919988 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bbf0ca3c-7dce-4787-ab3f-0b3f175cf655 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:58.920841 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bbf0ca3c-7dce-4787-ab3f-0b3f175cf655 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:58.925853 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:56:59.030919 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-443168b7-1db3-43c0-9436-2ccf9ec62e35 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:59.039737 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-443168b7-1db3-43c0-9436-2ccf9ec62e35 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c" status: 200 len: 1722 microversion: 2.1 time: 0.207309 Sep 12 23:56:59.040394 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 209/413] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:56:58 2022] GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c => generated 1722 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:56:59.046135 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-15fc7037-123d-4ef1-9592-32763e4ca557 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:56:59.049047 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-15fc7037-123d-4ef1-9592-32763e4ca557 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: 1bdd77eb-4b69-4630-9f49-a1d317bb1e12] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:56:59.056067 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-15fc7037-123d-4ef1-9592-32763e4ca557 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:59.056873 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-15fc7037-123d-4ef1-9592-32763e4ca557 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:59.057315 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-15fc7037-123d-4ef1-9592-32763e4ca557 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:59.058197 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-15fc7037-123d-4ef1-9592-32763e4ca557 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:56:59.059042 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-15fc7037-123d-4ef1-9592-32763e4ca557 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:56:59.059521 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-15fc7037-123d-4ef1-9592-32763e4ca557 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:56:59.092404 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-15fc7037-123d-4ef1-9592-32763e4ca557 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050618 Sep 12 23:56:59.097505 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 210/414] 10.222.0.26 () {58 vars in 1302 bytes} [Mon Sep 12 23:56:59 2022] GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:56:59.108846 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-bbf0ca3c-7dce-4787-ab3f-0b3f175cf655 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76b3353ce4b4361872ed6dba9f895d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f7d1c88224ebd85d15f7c43e7fe72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:56:59.117415 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-bbf0ca3c-7dce-4787-ab3f-0b3f175cf655 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a" status: 200 len: 1758 microversion: 2.1 time: 0.211900 Sep 12 23:56:59.118149 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 205/415] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:56:58 2022] GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a => generated 1758 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:57:00.066523 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8c3d329c-fc88-4e00-ad0d-115243a0890a tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:00.067076 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8c3d329c-fc88-4e00-ad0d-115243a0890a tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:00.074870 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8c3d329c-fc88-4e00-ad0d-115243a0890a tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:00.075397 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8c3d329c-fc88-4e00-ad0d-115243a0890a tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:00.075835 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8c3d329c-fc88-4e00-ad0d-115243a0890a tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:00.076551 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8c3d329c-fc88-4e00-ad0d-115243a0890a tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:00.077005 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8c3d329c-fc88-4e00-ad0d-115243a0890a tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:00.077402 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8c3d329c-fc88-4e00-ad0d-115243a0890a tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:00.105546 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0e02c618-6609-4efe-b925-44646499a224 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:00.107774 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0e02c618-6609-4efe-b925-44646499a224 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: 1bdd77eb-4b69-4630-9f49-a1d317bb1e12] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:00.114587 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0e02c618-6609-4efe-b925-44646499a224 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:00.115091 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0e02c618-6609-4efe-b925-44646499a224 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:00.115599 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0e02c618-6609-4efe-b925-44646499a224 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:00.116556 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0e02c618-6609-4efe-b925-44646499a224 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:00.117018 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0e02c618-6609-4efe-b925-44646499a224 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:00.117453 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0e02c618-6609-4efe-b925-44646499a224 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:00.148879 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0e02c618-6609-4efe-b925-44646499a224 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047519 Sep 12 23:57:00.149818 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 206/416] 10.222.0.26 () {58 vars in 1302 bytes} [Mon Sep 12 23:57:00 2022] GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 12 23:57:00.154666 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5a27b748-aae6-4e10-936d-85d391ab2e3c tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:00.155301 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5a27b748-aae6-4e10-936d-85d391ab2e3c tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] [instance: c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:00.161481 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5a27b748-aae6-4e10-936d-85d391ab2e3c tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:00.162084 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5a27b748-aae6-4e10-936d-85d391ab2e3c tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:00.162386 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5a27b748-aae6-4e10-936d-85d391ab2e3c tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:00.163144 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5a27b748-aae6-4e10-936d-85d391ab2e3c tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:00.163946 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5a27b748-aae6-4e10-936d-85d391ab2e3c tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:00.164128 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5a27b748-aae6-4e10-936d-85d391ab2e3c tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:00.257540 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8c3d329c-fc88-4e00-ad0d-115243a0890a tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:00.266328 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8c3d329c-fc88-4e00-ad0d-115243a0890a tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c" status: 200 len: 1722 microversion: 2.1 time: 0.204546 Sep 12 23:57:00.267137 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 211/417] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:00 2022] GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c => generated 1722 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:57:00.272218 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f1bc87be-1572-47cb-bcbd-376a1ac25eef tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:00.272811 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f1bc87be-1572-47cb-bcbd-376a1ac25eef tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: 1bdd77eb-4b69-4630-9f49-a1d317bb1e12] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:00.280083 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f1bc87be-1572-47cb-bcbd-376a1ac25eef tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:00.280563 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f1bc87be-1572-47cb-bcbd-376a1ac25eef tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:00.280987 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f1bc87be-1572-47cb-bcbd-376a1ac25eef tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:00.281688 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f1bc87be-1572-47cb-bcbd-376a1ac25eef tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:00.282131 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f1bc87be-1572-47cb-bcbd-376a1ac25eef tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:00.282540 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f1bc87be-1572-47cb-bcbd-376a1ac25eef tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:00.310352 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f1bc87be-1572-47cb-bcbd-376a1ac25eef tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: 1bdd77eb-4b69-4630-9f49-a1d317bb1e12] Going to try to terminate instance {{(pid=126975) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 23:57:00.325643 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:57:00.346139 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-5a27b748-aae6-4e10-936d-85d391ab2e3c tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76b3353ce4b4361872ed6dba9f895d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f7d1c88224ebd85d15f7c43e7fe72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:00.355652 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5a27b748-aae6-4e10-936d-85d391ab2e3c tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a" status: 200 len: 1758 microversion: 2.1 time: 0.204643 Sep 12 23:57:00.356145 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 207/418] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:00 2022] GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a => generated 1758 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:57:00.414478 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f1bc87be-1572-47cb-bcbd-376a1ac25eef tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12" status: 204 len: 0 microversion: 2.1 time: 0.145803 Sep 12 23:57:00.415109 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 212/419] 10.222.0.26 () {58 vars in 1239 bytes} [Mon Sep 12 23:57:00 2022] DELETE /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 12 23:57:00.423865 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-00034fe7-33ca-4ac1-9b0d-3b76eb9f61b0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:00.424478 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-00034fe7-33ca-4ac1-9b0d-3b76eb9f61b0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: 1bdd77eb-4b69-4630-9f49-a1d317bb1e12] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:00.431020 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-00034fe7-33ca-4ac1-9b0d-3b76eb9f61b0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:00.431548 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-00034fe7-33ca-4ac1-9b0d-3b76eb9f61b0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:00.432006 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-00034fe7-33ca-4ac1-9b0d-3b76eb9f61b0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:00.432691 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-00034fe7-33ca-4ac1-9b0d-3b76eb9f61b0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:00.433146 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-00034fe7-33ca-4ac1-9b0d-3b76eb9f61b0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:00.433569 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-00034fe7-33ca-4ac1-9b0d-3b76eb9f61b0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:00.574002 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-00034fe7-33ca-4ac1-9b0d-3b76eb9f61b0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:00.584999 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-00034fe7-33ca-4ac1-9b0d-3b76eb9f61b0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12" status: 200 len: 1681 microversion: 2.1 time: 0.165288 Sep 12 23:57:00.585565 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 208/420] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:00 2022] GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12 => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:57:01.291066 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f69cc392-59e2-42bc-a88e-b0f1c40f4d14 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:01.291788 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f69cc392-59e2-42bc-a88e-b0f1c40f4d14 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:01.298897 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f69cc392-59e2-42bc-a88e-b0f1c40f4d14 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:01.299444 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f69cc392-59e2-42bc-a88e-b0f1c40f4d14 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:01.299876 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f69cc392-59e2-42bc-a88e-b0f1c40f4d14 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:01.300607 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f69cc392-59e2-42bc-a88e-b0f1c40f4d14 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:01.301062 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f69cc392-59e2-42bc-a88e-b0f1c40f4d14 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:01.301482 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f69cc392-59e2-42bc-a88e-b0f1c40f4d14 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:01.380365 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b6ec7b8b-bb71-4482-90a5-ce8f185cddc8 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:01.381046 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b6ec7b8b-bb71-4482-90a5-ce8f185cddc8 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] [instance: c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:01.388331 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b6ec7b8b-bb71-4482-90a5-ce8f185cddc8 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:01.388899 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b6ec7b8b-bb71-4482-90a5-ce8f185cddc8 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:01.389406 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b6ec7b8b-bb71-4482-90a5-ce8f185cddc8 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:01.390226 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b6ec7b8b-bb71-4482-90a5-ce8f185cddc8 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:01.390750 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b6ec7b8b-bb71-4482-90a5-ce8f185cddc8 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:01.391210 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b6ec7b8b-bb71-4482-90a5-ce8f185cddc8 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:01.455342 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f69cc392-59e2-42bc-a88e-b0f1c40f4d14 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:01.463997 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f69cc392-59e2-42bc-a88e-b0f1c40f4d14 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c" status: 200 len: 1722 microversion: 2.1 time: 0.177344 Sep 12 23:57:01.464659 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 213/421] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:01 2022] GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:57:01.475345 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1c69e8e1-9ba1-45ac-86f8-af3f4da83f20 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed40638a-976a-4031-9703-eea367213210"}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:57:01.475345 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1c69e8e1-9ba1-45ac-86f8-af3f4da83f20 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 0be21a98-d3f6-4f26-8947-fd39015a7735] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:01.478552 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1c69e8e1-9ba1-45ac-86f8-af3f4da83f20 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:01.479051 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1c69e8e1-9ba1-45ac-86f8-af3f4da83f20 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:01.479621 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1c69e8e1-9ba1-45ac-86f8-af3f4da83f20 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:01.480352 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1c69e8e1-9ba1-45ac-86f8-af3f4da83f20 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:01.480799 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1c69e8e1-9ba1-45ac-86f8-af3f4da83f20 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:01.481222 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1c69e8e1-9ba1-45ac-86f8-af3f4da83f20 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:01.558966 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b6ec7b8b-bb71-4482-90a5-ce8f185cddc8 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76b3353ce4b4361872ed6dba9f895d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f7d1c88224ebd85d15f7c43e7fe72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:01.567696 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b6ec7b8b-bb71-4482-90a5-ce8f185cddc8 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a" status: 200 len: 1758 microversion: 2.1 time: 0.191454 Sep 12 23:57:01.568254 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 209/422] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:01 2022] GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a => generated 1758 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:57:01.608318 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4d39be81-5b37-4d72-91a8-b3b41e6b446c tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:01.608935 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-4d39be81-5b37-4d72-91a8-b3b41e6b446c tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: 1bdd77eb-4b69-4630-9f49-a1d317bb1e12] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:01.615060 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4d39be81-5b37-4d72-91a8-b3b41e6b446c tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:01.615590 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4d39be81-5b37-4d72-91a8-b3b41e6b446c tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:01.616023 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4d39be81-5b37-4d72-91a8-b3b41e6b446c tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:01.616711 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4d39be81-5b37-4d72-91a8-b3b41e6b446c tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:01.617159 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4d39be81-5b37-4d72-91a8-b3b41e6b446c tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:01.617576 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4d39be81-5b37-4d72-91a8-b3b41e6b446c tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:01.764058 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4d39be81-5b37-4d72-91a8-b3b41e6b446c tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:01.776513 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-4d39be81-5b37-4d72-91a8-b3b41e6b446c tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12" status: 200 len: 1681 microversion: 2.1 time: 0.171791 Sep 12 23:57:01.777407 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 210/423] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:01 2022] GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12 => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:57:02.111398 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1c69e8e1-9ba1-45ac-86f8-af3f4da83f20 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "POST /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.645077 Sep 12 23:57:02.112024 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 214/424] 10.222.0.26 () {60 vars in 1323 bytes} [Mon Sep 12 23:57:01 2022] POST /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735/os-volume_attachments => generated 194 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:57:02.488649 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-66fe51c7-8832-40b4-ad37-75d4fe1d255e tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:02.490259 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-66fe51c7-8832-40b4-ad37-75d4fe1d255e tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:02.497338 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-66fe51c7-8832-40b4-ad37-75d4fe1d255e tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:02.497961 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-66fe51c7-8832-40b4-ad37-75d4fe1d255e tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:02.498456 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-66fe51c7-8832-40b4-ad37-75d4fe1d255e tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:02.499249 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-66fe51c7-8832-40b4-ad37-75d4fe1d255e tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:02.499804 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-66fe51c7-8832-40b4-ad37-75d4fe1d255e tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:02.500312 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-66fe51c7-8832-40b4-ad37-75d4fe1d255e tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:02.592134 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8d38686a-708d-4b25-af3c-f74626d0187e tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:02.592900 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8d38686a-708d-4b25-af3c-f74626d0187e tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] [instance: c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:02.599765 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d38686a-708d-4b25-af3c-f74626d0187e tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:02.600328 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d38686a-708d-4b25-af3c-f74626d0187e tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:02.600863 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d38686a-708d-4b25-af3c-f74626d0187e tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:02.601613 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d38686a-708d-4b25-af3c-f74626d0187e tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:02.602259 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d38686a-708d-4b25-af3c-f74626d0187e tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:02.602720 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8d38686a-708d-4b25-af3c-f74626d0187e tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:02.806860 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-66fe51c7-8832-40b4-ad37-75d4fe1d255e tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:02.818181 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-66fe51c7-8832-40b4-ad37-75d4fe1d255e tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c" status: 200 len: 1722 microversion: 2.1 time: 0.333704 Sep 12 23:57:02.818791 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 211/425] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:02 2022] GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c => generated 1722 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:57:02.831146 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ea9cc1c0-fc75-4308-96a2-4aad2e367e0a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:02.831986 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ea9cc1c0-fc75-4308-96a2-4aad2e367e0a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: 1bdd77eb-4b69-4630-9f49-a1d317bb1e12] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:02.838953 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ea9cc1c0-fc75-4308-96a2-4aad2e367e0a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:02.839551 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ea9cc1c0-fc75-4308-96a2-4aad2e367e0a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:02.840106 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ea9cc1c0-fc75-4308-96a2-4aad2e367e0a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:02.840927 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ea9cc1c0-fc75-4308-96a2-4aad2e367e0a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:02.841390 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ea9cc1c0-fc75-4308-96a2-4aad2e367e0a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:02.841811 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ea9cc1c0-fc75-4308-96a2-4aad2e367e0a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:02.939044 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8d38686a-708d-4b25-af3c-f74626d0187e tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76b3353ce4b4361872ed6dba9f895d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f7d1c88224ebd85d15f7c43e7fe72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:02.948218 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8d38686a-708d-4b25-af3c-f74626d0187e tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a" status: 200 len: 1758 microversion: 2.1 time: 0.360463 Sep 12 23:57:02.948864 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 215/426] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:02 2022] GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a => generated 1758 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:57:03.092377 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ea9cc1c0-fc75-4308-96a2-4aad2e367e0a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:03.100635 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ea9cc1c0-fc75-4308-96a2-4aad2e367e0a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12" status: 200 len: 1681 microversion: 2.1 time: 0.280689 Sep 12 23:57:03.101233 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 212/427] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:02 2022] GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12 => generated 1681 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:57:03.579760 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-115ca0ba-8223-40df-bced-70ff4d3e96a3 req-ff452a99-a443-4801-a5c3-8591a730fe32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bdd77eb-4b69-4630-9f49-a1d317bb1e12", "name": "network-vif-deleted", "tag": "41507fcf-1ad4-4940-9dad-33c3404dea2d"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:57:03.595346 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-115ca0ba-8223-40df-bced-70ff4d3e96a3 req-ff452a99-a443-4801-a5c3-8591a730fe32 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:03.597652 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-115ca0ba-8223-40df-bced-70ff4d3e96a3 req-ff452a99-a443-4801-a5c3-8591a730fe32 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:03.598246 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-115ca0ba-8223-40df-bced-70ff4d3e96a3 req-ff452a99-a443-4801-a5c3-8591a730fe32 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:03.614406 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-115ca0ba-8223-40df-bced-70ff4d3e96a3 req-ff452a99-a443-4801-a5c3-8591a730fe32 service nova] Creating event network-vif-deleted:41507fcf-1ad4-4940-9dad-33c3404dea2d for instance 1bdd77eb-4b69-4630-9f49-a1d317bb1e12 on hv-cinder-82002 Sep 12 23:57:03.620031 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-115ca0ba-8223-40df-bced-70ff4d3e96a3 req-ff452a99-a443-4801-a5c3-8591a730fe32 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043863 Sep 12 23:57:03.621283 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 216/428] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:57:03.849711 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-80d8f0bf-e305-462a-89c9-13f84001e89b tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:03.850402 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-80d8f0bf-e305-462a-89c9-13f84001e89b tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:03.857951 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-80d8f0bf-e305-462a-89c9-13f84001e89b tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:03.858524 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-80d8f0bf-e305-462a-89c9-13f84001e89b tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:03.859094 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-80d8f0bf-e305-462a-89c9-13f84001e89b tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:03.859951 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-80d8f0bf-e305-462a-89c9-13f84001e89b tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:03.860484 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-80d8f0bf-e305-462a-89c9-13f84001e89b tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:03.860820 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-80d8f0bf-e305-462a-89c9-13f84001e89b tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:03.978788 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9186a77a-68c9-46f0-ba06-70162e5cff39 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:03.979610 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9186a77a-68c9-46f0-ba06-70162e5cff39 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] [instance: c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:03.988817 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9186a77a-68c9-46f0-ba06-70162e5cff39 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:03.989494 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9186a77a-68c9-46f0-ba06-70162e5cff39 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:03.990174 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9186a77a-68c9-46f0-ba06-70162e5cff39 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:03.990948 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9186a77a-68c9-46f0-ba06-70162e5cff39 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:03.991491 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9186a77a-68c9-46f0-ba06-70162e5cff39 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:03.991973 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9186a77a-68c9-46f0-ba06-70162e5cff39 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:04.009729 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-80d8f0bf-e305-462a-89c9-13f84001e89b tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:04.018570 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-80d8f0bf-e305-462a-89c9-13f84001e89b tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c" status: 200 len: 1722 microversion: 2.1 time: 0.173341 Sep 12 23:57:04.019069 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 213/429] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:03 2022] GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:57:04.128671 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f9960c99-61b9-437d-89b6-f968b1da3f68 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:04.129873 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f9960c99-61b9-437d-89b6-f968b1da3f68 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: 1bdd77eb-4b69-4630-9f49-a1d317bb1e12] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:04.140964 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f9960c99-61b9-437d-89b6-f968b1da3f68 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:04.141811 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f9960c99-61b9-437d-89b6-f968b1da3f68 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:04.142425 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f9960c99-61b9-437d-89b6-f968b1da3f68 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:04.143407 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f9960c99-61b9-437d-89b6-f968b1da3f68 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:04.143864 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f9960c99-61b9-437d-89b6-f968b1da3f68 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:04.144287 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f9960c99-61b9-437d-89b6-f968b1da3f68 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:04.183579 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f9960c99-61b9-437d-89b6-f968b1da3f68 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:04.184327 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f9960c99-61b9-437d-89b6-f968b1da3f68 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:04.184734 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f9960c99-61b9-437d-89b6-f968b1da3f68 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:04.185209 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.objects.instance [None req-f9960c99-61b9-437d-89b6-f968b1da3f68 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lazy-loading 'fault' on Instance uuid 1bdd77eb-4b69-4630-9f49-a1d317bb1e12 {{(pid=126976) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 23:57:04.200110 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9186a77a-68c9-46f0-ba06-70162e5cff39 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76b3353ce4b4361872ed6dba9f895d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f7d1c88224ebd85d15f7c43e7fe72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:04.215999 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9186a77a-68c9-46f0-ba06-70162e5cff39 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a" status: 200 len: 1758 microversion: 2.1 time: 0.241146 Sep 12 23:57:04.217161 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 217/430] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:03 2022] GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a => generated 1758 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:57:04.233689 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f9960c99-61b9-437d-89b6-f968b1da3f68 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:04.241855 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f9960c99-61b9-437d-89b6-f968b1da3f68 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12" status: 200 len: 1330 microversion: 2.1 time: 0.120379 Sep 12 23:57:04.242689 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 214/431] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:04 2022] GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12 => generated 1330 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:57:05.056163 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0aac01cc-712a-4c59-b8ca-c36de41a89d6 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:05.056699 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0aac01cc-712a-4c59-b8ca-c36de41a89d6 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:05.063339 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0aac01cc-712a-4c59-b8ca-c36de41a89d6 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:05.063825 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0aac01cc-712a-4c59-b8ca-c36de41a89d6 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:05.064267 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0aac01cc-712a-4c59-b8ca-c36de41a89d6 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:05.064976 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0aac01cc-712a-4c59-b8ca-c36de41a89d6 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:05.065427 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0aac01cc-712a-4c59-b8ca-c36de41a89d6 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:05.065847 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0aac01cc-712a-4c59-b8ca-c36de41a89d6 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:05.233768 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0aac01cc-712a-4c59-b8ca-c36de41a89d6 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:05.239214 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-024f3aea-40f5-4868-804c-025d7c10c450 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:05.239851 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-024f3aea-40f5-4868-804c-025d7c10c450 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] [instance: c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:05.242608 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0aac01cc-712a-4c59-b8ca-c36de41a89d6 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c" status: 200 len: 1722 microversion: 2.1 time: 0.190382 Sep 12 23:57:05.243390 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 218/432] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:05 2022] GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:57:05.246661 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-024f3aea-40f5-4868-804c-025d7c10c450 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:05.247158 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-024f3aea-40f5-4868-804c-025d7c10c450 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:05.247617 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-024f3aea-40f5-4868-804c-025d7c10c450 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:05.248320 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-024f3aea-40f5-4868-804c-025d7c10c450 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:05.248771 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-024f3aea-40f5-4868-804c-025d7c10c450 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:05.249191 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-024f3aea-40f5-4868-804c-025d7c10c450 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:05.265048 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-dcf8a424-af1a-4de0-a729-27de12e543a0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:05.265907 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-dcf8a424-af1a-4de0-a729-27de12e543a0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: 1bdd77eb-4b69-4630-9f49-a1d317bb1e12] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:05.272255 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dcf8a424-af1a-4de0-a729-27de12e543a0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:05.272749 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dcf8a424-af1a-4de0-a729-27de12e543a0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:05.273165 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dcf8a424-af1a-4de0-a729-27de12e543a0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:05.274994 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dcf8a424-af1a-4de0-a729-27de12e543a0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:05.275736 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dcf8a424-af1a-4de0-a729-27de12e543a0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:05.276219 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dcf8a424-af1a-4de0-a729-27de12e543a0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:05.291251 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-dcf8a424-af1a-4de0-a729-27de12e543a0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] HTTP exception thrown: Instance 1bdd77eb-4b69-4630-9f49-a1d317bb1e12 could not be found. Sep 12 23:57:05.292982 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-dcf8a424-af1a-4de0-a729-27de12e543a0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Request method failure captured: Sep 12 23:57:05.292982 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: request: GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12 HTTP/1.1 Sep 12 23:57:05.292982 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept: application/json Sep 12 23:57:05.292982 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Sep 12 23:57:05.292982 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Connection: close Sep 12 23:57:05.292982 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Length: 0 Sep 12 23:57:05.292982 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Type: application/json Sep 12 23:57:05.292982 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Host: 10.222.0.26 Sep 12 23:57:05.292982 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Sep 12 23:57:05.292982 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Sep 12 23:57:05.292982 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjH8Z2hSl_dF3G_DVeQeMffC839mjKCX1ldHy7KYxwLbzxfI-Hnili9xft2wG7WgRYfuNYC0jIjSduHyiAWMPed8uo_fiAxdNKw8dFJEFK0lHOKo1_8VeXMUxxHgYF50XY0v_lkkNk_ejqmvpqtZKiNqfO8LXenu9zNmJy4upaAKztdpU Sep 12 23:57:05.292982 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Sep 12 23:57:05.292982 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Sep 12 23:57:05.292982 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Sep 12 23:57:05.292982 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Sep 12 23:57:05.292982 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Sep 12 23:57:05.292982 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Sep 12 23:57:05.292982 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Id: 6c681f1232de4a5fbfc728c230f80624 Sep 12 23:57:05.292982 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-AttachVolumeNegativeTest-1965954712 Sep 12 23:57:05.292982 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Role: member,reader Sep 12 23:57:05.292982 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Roles: member,reader Sep 12 23:57:05.294549 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6c681f1232de4a5fbfc728c230f80624"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6c681f1232de4a5fbfc728c230f80624"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6c681f1232de4a5fbfc728c230f80624"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6c681f1232de4a5fbfc728c230f80624"}]}] Sep 12 23:57:05.294549 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-AttachVolumeNegativeTest-1965954712 Sep 12 23:57:05.294549 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Id: 6c681f1232de4a5fbfc728c230f80624 Sep 12 23:57:05.294549 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1965954712 Sep 12 23:57:05.294549 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User: tempest-AttachVolumeNegativeTest-1965954712-project Sep 12 23:57:05.294549 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Sep 12 23:57:05.294549 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Sep 12 23:57:05.294549 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Id: a8cbfc74644f4d4594a70b833ad7002c Sep 12 23:57:05.294549 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-AttachVolumeNegativeTest-1965954712-project Sep 12 23:57:05.294549 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: method: > Sep 12 23:57:05.294549 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: exception: Instance 1bdd77eb-4b69-4630-9f49-a1d317bb1e12 could not be found. Sep 12 23:57:05.294549 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: action_args: {'id': '1bdd77eb-4b69-4630-9f49-a1d317bb1e12'} Sep 12 23:57:05.295409 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:57:05.295409 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:57:05.295409 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:57:05.295409 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:57:05.295409 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:57:05.295409 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:57:05.295409 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:57:05.295409 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:57:05.295409 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:57:05.295409 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:57:05.295409 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bdd77eb-4b69-4630-9f49-a1d317bb1e12 could not be found. Sep 12 23:57:05.295409 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:57:05.295409 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:57:05.295409 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:57:05.295409 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:57:05.295409 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:57:05.295409 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:57:05.295409 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:57:05.295409 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:57:05.295409 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:57:05.297075 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:57:05.297075 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 23:57:05.297075 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 23:57:05.297075 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:57:05.297075 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:57:05.297075 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:57:05.297075 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:57:05.297075 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bdd77eb-4b69-4630-9f49-a1d317bb1e12 could not be found. Sep 12 23:57:05.297075 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:57:05.297075 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:57:05.297075 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:57:05.297075 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:57:05.297075 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:57:05.297075 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:57:05.297075 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:57:05.297075 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:57:05.297075 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bdd77eb-4b69-4630-9f49-a1d317bb1e12 could not be found. Sep 12 23:57:05.297075 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:57:05.298714 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-dcf8a424-af1a-4de0-a729-27de12e543a0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Returning 404 to user: Instance 1bdd77eb-4b69-4630-9f49-a1d317bb1e12 could not be found. {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:57:05.298714 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-dcf8a424-af1a-4de0-a729-27de12e543a0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12" status: 404 len: 111 microversion: 2.1 time: 0.033318 Sep 12 23:57:05.299293 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 219/433] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:05 2022] GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:57:05.304342 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-54e0e442-553e-4e28-9dc1-d8864d8335bc tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '.version_select at 0x7fed015573a0>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:05.334225 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-54e0e442-553e-4e28-9dc1-d8864d8335bc tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-43140354" status: 202 len: 0 microversion: 2.1 time: 0.033160 Sep 12 23:57:05.334457 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 220/434] 10.222.0.26 () {58 vars in 1215 bytes} [Mon Sep 12 23:57:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-43140354 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 23:57:05.456160 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-024f3aea-40f5-4868-804c-025d7c10c450 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76b3353ce4b4361872ed6dba9f895d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f7d1c88224ebd85d15f7c43e7fe72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:05.465162 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-024f3aea-40f5-4868-804c-025d7c10c450 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a" status: 200 len: 1758 microversion: 2.1 time: 0.229714 Sep 12 23:57:05.465733 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 215/435] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:05 2022] GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a => generated 1758 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:57:06.056187 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-cc5f80fe-a3c3-4026-b2b4-7a95073cac20 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Action: 'create', calling method: .version_select at 0x7fed015373a0>, body: {"keypair": {"name": "tempest-keypair-220770329", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMZRNBDjQwbADj1hZy1x4CgbOtiI7vOAeAetAiT1aYYO/uwpv9+5U4ElMUHSAfB2ZgLke+4hd3O/o/W+W8rUlIEN0JnAsX7RWVxeP2SpfRkGRbzOi9oO0X8FRJfA/OXqw=="}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:57:06.072836 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-cc5f80fe-a3c3-4026-b2b4-7a95073cac20 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Getting quotas for project 6c681f1232de4a5fbfc728c230f80624. Resources: {'key_pairs'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 23:57:06.076703 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-cc5f80fe-a3c3-4026-b2b4-7a95073cac20 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Getting quotas for user a8cbfc74644f4d4594a70b833ad7002c and project 6c681f1232de4a5fbfc728c230f80624. Resources: {'key_pairs'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 23:57:06.099732 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-cc5f80fe-a3c3-4026-b2b4-7a95073cac20 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047706 Sep 12 23:57:06.100345 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 221/436] 10.222.0.26 () {60 vars in 1159 bytes} [Mon Sep 12 23:57:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 23:57:06.266254 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7d097dcd-65b0-4397-928d-62ffda611b39 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:06.267048 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7d097dcd-65b0-4397-928d-62ffda611b39 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:06.273666 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7d097dcd-65b0-4397-928d-62ffda611b39 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:06.274490 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7d097dcd-65b0-4397-928d-62ffda611b39 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:06.274939 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7d097dcd-65b0-4397-928d-62ffda611b39 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:06.275716 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7d097dcd-65b0-4397-928d-62ffda611b39 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:06.276159 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7d097dcd-65b0-4397-928d-62ffda611b39 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:06.276592 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7d097dcd-65b0-4397-928d-62ffda611b39 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:06.418482 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7d097dcd-65b0-4397-928d-62ffda611b39 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:06.428004 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7d097dcd-65b0-4397-928d-62ffda611b39 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c" status: 200 len: 1722 microversion: 2.1 time: 0.165828 Sep 12 23:57:06.429167 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 216/437] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:06 2022] GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:57:06.490090 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2a0d4177-879a-4a7c-b057-dbe50e69015c tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:06.490690 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2a0d4177-879a-4a7c-b057-dbe50e69015c tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] [instance: c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:06.497627 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2a0d4177-879a-4a7c-b057-dbe50e69015c tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:06.498070 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2a0d4177-879a-4a7c-b057-dbe50e69015c tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:06.498705 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2a0d4177-879a-4a7c-b057-dbe50e69015c tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:06.499439 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2a0d4177-879a-4a7c-b057-dbe50e69015c tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:06.499861 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2a0d4177-879a-4a7c-b057-dbe50e69015c tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:06.500478 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2a0d4177-879a-4a7c-b057-dbe50e69015c tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:06.739440 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2a0d4177-879a-4a7c-b057-dbe50e69015c tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76b3353ce4b4361872ed6dba9f895d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f7d1c88224ebd85d15f7c43e7fe72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:06.748869 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2a0d4177-879a-4a7c-b057-dbe50e69015c tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a" status: 200 len: 1761 microversion: 2.1 time: 0.262519 Sep 12 23:57:06.749476 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 222/438] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:06 2022] GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a => generated 1761 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:57:07.457430 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d6ae9b06-afc1-4933-9265-b61d9017cbaa tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:07.459093 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d6ae9b06-afc1-4933-9265-b61d9017cbaa tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:07.469021 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d6ae9b06-afc1-4933-9265-b61d9017cbaa tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:07.470033 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d6ae9b06-afc1-4933-9265-b61d9017cbaa tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:07.470574 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d6ae9b06-afc1-4933-9265-b61d9017cbaa tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:07.471469 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d6ae9b06-afc1-4933-9265-b61d9017cbaa tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:07.472068 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d6ae9b06-afc1-4933-9265-b61d9017cbaa tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:07.472540 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d6ae9b06-afc1-4933-9265-b61d9017cbaa tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:07.590926 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-17ad923b-4082-4b74-99a5-304a3d1f561e tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-972150493", "imageRef": "22a47167-5e04-441a-a504-d76d82afc776", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3c1b7b6d-23b0-4d33-9526-13eb374ddc8c"}], "security_groups": [{"name": "tempest-securitygroup--46810224"}], "key_name": "tempest-keypair-220770329", "user_data": "}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:57:07.631656 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d6ae9b06-afc1-4933-9265-b61d9017cbaa tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:07.640499 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d6ae9b06-afc1-4933-9265-b61d9017cbaa tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c" status: 200 len: 1722 microversion: 2.1 time: 0.191341 Sep 12 23:57:07.641071 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 217/439] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:07 2022] GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:57:07.721462 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.network.neutron [None req-17ad923b-4082-4b74-99a5-304a3d1f561e tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] validate_networks() for [('3c1b7b6d-23b0-4d33-9526-13eb374ddc8c', None, None, None, None, None)] {{(pid=126975) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 23:57:08.127983 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-17ad923b-4082-4b74-99a5-304a3d1f561e tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Flavor limits 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 23:57:08.128442 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-17ad923b-4082-4b74-99a5-304a3d1f561e tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Image limits 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 23:57:08.128904 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-17ad923b-4082-4b74-99a5-304a3d1f561e tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Flavor pref 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 23:57:08.129369 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-17ad923b-4082-4b74-99a5-304a3d1f561e tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Image pref 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 23:57:08.129808 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-17ad923b-4082-4b74-99a5-304a3d1f561e tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 23:57:08.140977 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-17ad923b-4082-4b74-99a5-304a3d1f561e tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:08.141462 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-17ad923b-4082-4b74-99a5-304a3d1f561e tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:08.141893 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-17ad923b-4082-4b74-99a5-304a3d1f561e tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:08.142713 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-17ad923b-4082-4b74-99a5-304a3d1f561e tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:08.143174 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-17ad923b-4082-4b74-99a5-304a3d1f561e tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:08.143645 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-17ad923b-4082-4b74-99a5-304a3d1f561e tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:08.164107 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-17ad923b-4082-4b74-99a5-304a3d1f561e tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Getting quotas for project 6c681f1232de4a5fbfc728c230f80624. Resources: {'instances', 'cores', 'ram'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 23:57:08.169662 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-17ad923b-4082-4b74-99a5-304a3d1f561e tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Getting quotas for user a8cbfc74644f4d4594a70b833ad7002c and project 6c681f1232de4a5fbfc728c230f80624. Resources: {'instances', 'cores', 'ram'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 23:57:08.185286 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-17ad923b-4082-4b74-99a5-304a3d1f561e tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Going to run 1 instances... {{(pid=126975) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 23:57:08.187790 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-17ad923b-4082-4b74-99a5-304a3d1f561e tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: f1ff4faa-6a45-4d62-9e44-80dba7a947c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='22a47167-5e04-441a-a504-d76d82afc776',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126975) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 23:57:08.240653 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-17ad923b-4082-4b74-99a5-304a3d1f561e tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.654200 Sep 12 23:57:08.241559 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 223/440] 10.222.0.26 () {60 vars in 1147 bytes} [Mon Sep 12 23:57:07 2022] POST /compute/v2.1/servers => generated 400 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 12 23:57:08.255497 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d985bb46-b9bc-4977-afa3-53a4aac61f89 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:08.256305 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d985bb46-b9bc-4977-afa3-53a4aac61f89 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: f1ff4faa-6a45-4d62-9e44-80dba7a947c0] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:08.319249 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d985bb46-b9bc-4977-afa3-53a4aac61f89 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:08.327684 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d985bb46-b9bc-4977-afa3-53a4aac61f89 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0" status: 200 len: 1240 microversion: 2.1 time: 0.076698 Sep 12 23:57:08.328652 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 218/441] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:08 2022] GET /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0 => generated 1240 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:57:08.665823 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c0d96ba0-b64e-480b-83e9-4fd96353b8bc tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:08.666438 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c0d96ba0-b64e-480b-83e9-4fd96353b8bc tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:08.675145 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c0d96ba0-b64e-480b-83e9-4fd96353b8bc tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:08.675818 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c0d96ba0-b64e-480b-83e9-4fd96353b8bc tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:08.676575 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c0d96ba0-b64e-480b-83e9-4fd96353b8bc tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:08.677807 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c0d96ba0-b64e-480b-83e9-4fd96353b8bc tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:08.678957 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c0d96ba0-b64e-480b-83e9-4fd96353b8bc tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:08.680184 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c0d96ba0-b64e-480b-83e9-4fd96353b8bc tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:08.929304 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c0d96ba0-b64e-480b-83e9-4fd96353b8bc tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:08.938878 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c0d96ba0-b64e-480b-83e9-4fd96353b8bc tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c" status: 200 len: 1722 microversion: 2.1 time: 0.277380 Sep 12 23:57:08.939518 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 224/442] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:08 2022] GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c => generated 1722 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:57:09.359920 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b6129d68-d2c9-43db-9f47-aa1bfc789062 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:09.360500 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b6129d68-d2c9-43db-9f47-aa1bfc789062 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: f1ff4faa-6a45-4d62-9e44-80dba7a947c0] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:09.368757 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b6129d68-d2c9-43db-9f47-aa1bfc789062 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:09.369219 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b6129d68-d2c9-43db-9f47-aa1bfc789062 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:09.369677 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b6129d68-d2c9-43db-9f47-aa1bfc789062 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:09.370388 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b6129d68-d2c9-43db-9f47-aa1bfc789062 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:09.374392 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b6129d68-d2c9-43db-9f47-aa1bfc789062 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:09.374392 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b6129d68-d2c9-43db-9f47-aa1bfc789062 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:09.436898 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b6129d68-d2c9-43db-9f47-aa1bfc789062 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:09.445057 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b6129d68-d2c9-43db-9f47-aa1bfc789062 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0" status: 200 len: 1292 microversion: 2.1 time: 0.089043 Sep 12 23:57:09.445796 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 219/443] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:09 2022] GET /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0 => generated 1292 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:57:09.800572 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ed54b5cf-4b5e-43b3-b42e-795c351b5c8c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:57:09.802986 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ed54b5cf-4b5e-43b3-b42e-795c351b5c8c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 0be21a98-d3f6-4f26-8947-fd39015a7735] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:09.813067 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ed54b5cf-4b5e-43b3-b42e-795c351b5c8c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:09.814115 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ed54b5cf-4b5e-43b3-b42e-795c351b5c8c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:09.814716 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ed54b5cf-4b5e-43b3-b42e-795c351b5c8c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:09.815631 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ed54b5cf-4b5e-43b3-b42e-795c351b5c8c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:09.816259 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ed54b5cf-4b5e-43b3-b42e-795c351b5c8c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:09.816847 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ed54b5cf-4b5e-43b3-b42e-795c351b5c8c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:09.845227 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.objects.instance [None req-ed54b5cf-4b5e-43b3-b42e-795c351b5c8c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lazy-loading 'flavor' on Instance uuid 0be21a98-d3f6-4f26-8947-fd39015a7735 {{(pid=126975) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 23:57:09.963742 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7832523c-d55a-445c-8b4d-6e175538e7a1 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:09.964360 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7832523c-d55a-445c-8b4d-6e175538e7a1 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:09.977345 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7832523c-d55a-445c-8b4d-6e175538e7a1 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:09.977848 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7832523c-d55a-445c-8b4d-6e175538e7a1 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:09.980098 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7832523c-d55a-445c-8b4d-6e175538e7a1 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:09.981184 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7832523c-d55a-445c-8b4d-6e175538e7a1 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:09.981981 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7832523c-d55a-445c-8b4d-6e175538e7a1 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:09.982598 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7832523c-d55a-445c-8b4d-6e175538e7a1 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:10.033893 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ed54b5cf-4b5e-43b3-b42e-795c351b5c8c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "POST /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735/action" status: 200 len: 32 microversion: 2.1 time: 0.236776 Sep 12 23:57:10.040007 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 225/444] 10.222.0.26 () {60 vars in 1278 bytes} [Mon Sep 12 23:57:09 2022] POST /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735/action => generated 32 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 12 23:57:10.051340 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1e300ec6-ec40-4da5-af9a-51223aa1ca2e tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:10.052539 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1e300ec6-ec40-4da5-af9a-51223aa1ca2e tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 0be21a98-d3f6-4f26-8947-fd39015a7735] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:10.061609 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1e300ec6-ec40-4da5-af9a-51223aa1ca2e tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:10.062445 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1e300ec6-ec40-4da5-af9a-51223aa1ca2e tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:10.063450 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1e300ec6-ec40-4da5-af9a-51223aa1ca2e tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:10.064735 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1e300ec6-ec40-4da5-af9a-51223aa1ca2e tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:10.065401 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1e300ec6-ec40-4da5-af9a-51223aa1ca2e tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:10.066112 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1e300ec6-ec40-4da5-af9a-51223aa1ca2e tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:10.745087 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7832523c-d55a-445c-8b4d-6e175538e7a1 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:10.754650 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7832523c-d55a-445c-8b4d-6e175538e7a1 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c" status: 200 len: 1699 microversion: 2.1 time: 0.795352 Sep 12 23:57:10.755273 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 220/445] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:09 2022] GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c => generated 1699 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:57:10.760132 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c815886e-30f0-4dbb-a8d1-732ae7d30a87 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:10.760747 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c815886e-30f0-4dbb-a8d1-732ae7d30a87 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: f1ff4faa-6a45-4d62-9e44-80dba7a947c0] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:10.767170 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c815886e-30f0-4dbb-a8d1-732ae7d30a87 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:10.767695 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c815886e-30f0-4dbb-a8d1-732ae7d30a87 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:10.768129 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c815886e-30f0-4dbb-a8d1-732ae7d30a87 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:10.768843 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c815886e-30f0-4dbb-a8d1-732ae7d30a87 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:10.769332 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c815886e-30f0-4dbb-a8d1-732ae7d30a87 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:10.769723 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c815886e-30f0-4dbb-a8d1-732ae7d30a87 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:10.831345 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-1e300ec6-ec40-4da5-af9a-51223aa1ca2e tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:10.840056 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1e300ec6-ec40-4da5-af9a-51223aa1ca2e tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735" status: 200 len: 1735 microversion: 2.1 time: 0.798355 Sep 12 23:57:10.840647 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 226/446] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:10 2022] GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735 => generated 1735 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:57:10.845382 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-cc154f85-006d-403b-b19a-7e42b65f190c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:57:10.852269 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cc154f85-006d-403b-b19a-7e42b65f190c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:10.852758 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cc154f85-006d-403b-b19a-7e42b65f190c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:10.853188 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cc154f85-006d-403b-b19a-7e42b65f190c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:10.871594 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c815886e-30f0-4dbb-a8d1-732ae7d30a87 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:10.882409 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c815886e-30f0-4dbb-a8d1-732ae7d30a87 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0" status: 200 len: 1298 microversion: 2.1 time: 0.126004 Sep 12 23:57:10.883514 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 221/447] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:10 2022] GET /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0 => generated 1298 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:57:10.916756 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-cc154f85-006d-403b-b19a-7e42b65f190c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Going to try to start instance {{(pid=126975) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 12 23:57:10.954209 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:57:10.966797 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-cc154f85-006d-403b-b19a-7e42b65f190c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "POST /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c/action" status: 202 len: 0 microversion: 2.1 time: 0.124900 Sep 12 23:57:10.967766 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 227/448] 10.222.0.26 () {60 vars in 1278 bytes} [Mon Sep 12 23:57:10 2022] POST /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 23:57:10.976429 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1bfef688-5fc5-4f18-90af-9d2c1cb16768 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:10.977342 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1bfef688-5fc5-4f18-90af-9d2c1cb16768 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:10.984320 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1bfef688-5fc5-4f18-90af-9d2c1cb16768 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:10.984913 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1bfef688-5fc5-4f18-90af-9d2c1cb16768 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:10.985417 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1bfef688-5fc5-4f18-90af-9d2c1cb16768 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:10.986203 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1bfef688-5fc5-4f18-90af-9d2c1cb16768 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:10.986926 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1bfef688-5fc5-4f18-90af-9d2c1cb16768 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:10.987693 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1bfef688-5fc5-4f18-90af-9d2c1cb16768 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:11.006410 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:57:11.466407 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-1bfef688-5fc5-4f18-90af-9d2c1cb16768 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:11.476171 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1bfef688-5fc5-4f18-90af-9d2c1cb16768 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c" status: 200 len: 1708 microversion: 2.1 time: 0.503782 Sep 12 23:57:11.476856 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 222/449] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:10 2022] GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c => generated 1708 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:57:11.866664 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f4535589-eae5-4a15-8548-f5f3a38b2074 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:11.867529 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f4535589-eae5-4a15-8548-f5f3a38b2074 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 0be21a98-d3f6-4f26-8947-fd39015a7735] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:11.875303 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4535589-eae5-4a15-8548-f5f3a38b2074 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:11.875817 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4535589-eae5-4a15-8548-f5f3a38b2074 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:11.876251 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4535589-eae5-4a15-8548-f5f3a38b2074 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:11.876987 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4535589-eae5-4a15-8548-f5f3a38b2074 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:11.877447 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4535589-eae5-4a15-8548-f5f3a38b2074 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:11.877871 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4535589-eae5-4a15-8548-f5f3a38b2074 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:11.920177 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7597962b-813a-4360-ac5f-08d8b2df3d0a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:11.921358 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7597962b-813a-4360-ac5f-08d8b2df3d0a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: f1ff4faa-6a45-4d62-9e44-80dba7a947c0] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:11.930666 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7597962b-813a-4360-ac5f-08d8b2df3d0a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:11.931166 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7597962b-813a-4360-ac5f-08d8b2df3d0a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:11.932502 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7597962b-813a-4360-ac5f-08d8b2df3d0a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:11.933210 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7597962b-813a-4360-ac5f-08d8b2df3d0a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:11.933672 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7597962b-813a-4360-ac5f-08d8b2df3d0a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:11.934100 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7597962b-813a-4360-ac5f-08d8b2df3d0a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:12.292535 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f4535589-eae5-4a15-8548-f5f3a38b2074 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:12.303791 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f4535589-eae5-4a15-8548-f5f3a38b2074 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735" status: 200 len: 1735 microversion: 2.1 time: 0.442669 Sep 12 23:57:12.304433 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 228/450] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:11 2022] GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735 => generated 1735 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:57:12.318331 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7597962b-813a-4360-ac5f-08d8b2df3d0a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:12.328321 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7597962b-813a-4360-ac5f-08d8b2df3d0a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0" status: 200 len: 1364 microversion: 2.1 time: 0.414020 Sep 12 23:57:12.329525 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 223/451] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:11 2022] GET /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0 => generated 1364 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:57:12.506326 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-67f022fb-5561-49a3-8a7c-40c217cbfced tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:12.506943 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-67f022fb-5561-49a3-8a7c-40c217cbfced tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:12.509851 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:57:12.517068 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-67f022fb-5561-49a3-8a7c-40c217cbfced tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:12.517860 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-67f022fb-5561-49a3-8a7c-40c217cbfced tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:12.518387 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-67f022fb-5561-49a3-8a7c-40c217cbfced tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:12.519339 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-67f022fb-5561-49a3-8a7c-40c217cbfced tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:12.519983 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-67f022fb-5561-49a3-8a7c-40c217cbfced tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:12.520414 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-67f022fb-5561-49a3-8a7c-40c217cbfced tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:12.764347 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-67f022fb-5561-49a3-8a7c-40c217cbfced tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:12.774798 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-67f022fb-5561-49a3-8a7c-40c217cbfced tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c" status: 200 len: 1708 microversion: 2.1 time: 0.271984 Sep 12 23:57:12.775767 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 229/452] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:12 2022] GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c => generated 1708 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:57:13.177555 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-8708d632-e5bb-4f48-8bb8-449dc1ff3463 req-49e445e6-db89-4021-8dd3-ae2cac121cae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1ff4faa-6a45-4d62-9e44-80dba7a947c0", "tag": "cd5278d3-b6b8-4ed3-ba84-c102f2c6a074"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:57:13.188085 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-8708d632-e5bb-4f48-8bb8-449dc1ff3463 req-49e445e6-db89-4021-8dd3-ae2cac121cae service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:13.188636 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-8708d632-e5bb-4f48-8bb8-449dc1ff3463 req-49e445e6-db89-4021-8dd3-ae2cac121cae service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:13.189062 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-8708d632-e5bb-4f48-8bb8-449dc1ff3463 req-49e445e6-db89-4021-8dd3-ae2cac121cae service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:13.201004 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-8708d632-e5bb-4f48-8bb8-449dc1ff3463 req-49e445e6-db89-4021-8dd3-ae2cac121cae service nova] Creating event network-changed:cd5278d3-b6b8-4ed3-ba84-c102f2c6a074 for instance f1ff4faa-6a45-4d62-9e44-80dba7a947c0 on hv-cinder-82002 Sep 12 23:57:13.206371 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-8708d632-e5bb-4f48-8bb8-449dc1ff3463 req-49e445e6-db89-4021-8dd3-ae2cac121cae service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032570 Sep 12 23:57:13.206952 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 224/453] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:57:13.330357 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-694f6373-5320-4146-9f01-ddaf206c7b4b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:13.330974 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-694f6373-5320-4146-9f01-ddaf206c7b4b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 0be21a98-d3f6-4f26-8947-fd39015a7735] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:13.337985 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-694f6373-5320-4146-9f01-ddaf206c7b4b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:13.338733 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-694f6373-5320-4146-9f01-ddaf206c7b4b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:13.339441 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-694f6373-5320-4146-9f01-ddaf206c7b4b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:13.340508 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-694f6373-5320-4146-9f01-ddaf206c7b4b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:13.341205 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-694f6373-5320-4146-9f01-ddaf206c7b4b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:13.341897 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-694f6373-5320-4146-9f01-ddaf206c7b4b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:13.353213 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-05871dda-a7e1-454d-a987-62fb8736bedc tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:13.353964 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-05871dda-a7e1-454d-a987-62fb8736bedc tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: f1ff4faa-6a45-4d62-9e44-80dba7a947c0] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:13.360595 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-05871dda-a7e1-454d-a987-62fb8736bedc tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:13.361075 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-05871dda-a7e1-454d-a987-62fb8736bedc tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:13.361507 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-05871dda-a7e1-454d-a987-62fb8736bedc tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:13.362408 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-05871dda-a7e1-454d-a987-62fb8736bedc tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:13.362856 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-05871dda-a7e1-454d-a987-62fb8736bedc tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:13.364028 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-05871dda-a7e1-454d-a987-62fb8736bedc tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:13.555951 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-694f6373-5320-4146-9f01-ddaf206c7b4b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:13.558562 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-05871dda-a7e1-454d-a987-62fb8736bedc tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:13.565303 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-694f6373-5320-4146-9f01-ddaf206c7b4b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735" status: 200 len: 1735 microversion: 2.1 time: 0.239801 Sep 12 23:57:13.565914 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 230/454] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:13 2022] GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735 => generated 1735 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:57:13.567858 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-05871dda-a7e1-454d-a987-62fb8736bedc tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0" status: 200 len: 1364 microversion: 2.1 time: 0.218918 Sep 12 23:57:13.568557 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 225/455] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:13 2022] GET /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0 => generated 1364 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:57:13.799892 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f4faeafc-603e-49a6-95e2-48329973ff5d tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:13.800500 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f4faeafc-603e-49a6-95e2-48329973ff5d tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:13.806672 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4faeafc-603e-49a6-95e2-48329973ff5d tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:13.807126 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4faeafc-603e-49a6-95e2-48329973ff5d tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:13.807619 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4faeafc-603e-49a6-95e2-48329973ff5d tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:13.808317 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4faeafc-603e-49a6-95e2-48329973ff5d tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:13.808774 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4faeafc-603e-49a6-95e2-48329973ff5d tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:13.809196 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f4faeafc-603e-49a6-95e2-48329973ff5d tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:14.337039 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f4faeafc-603e-49a6-95e2-48329973ff5d tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:14.345945 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f4faeafc-603e-49a6-95e2-48329973ff5d tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c" status: 200 len: 1712 microversion: 2.1 time: 0.550000 Sep 12 23:57:14.346699 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 231/456] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:13 2022] GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c => generated 1712 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:57:14.590674 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f96b5aaf-2bbd-4827-a6b2-68b00e7e7eab tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:14.591191 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d59a4c97-0478-4ad0-8895-22b583ab1f12 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:14.591805 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d59a4c97-0478-4ad0-8895-22b583ab1f12 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: f1ff4faa-6a45-4d62-9e44-80dba7a947c0] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:14.592003 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f96b5aaf-2bbd-4827-a6b2-68b00e7e7eab tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 0be21a98-d3f6-4f26-8947-fd39015a7735] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:14.598215 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d59a4c97-0478-4ad0-8895-22b583ab1f12 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:14.598705 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d59a4c97-0478-4ad0-8895-22b583ab1f12 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:14.599185 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f96b5aaf-2bbd-4827-a6b2-68b00e7e7eab tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:14.599372 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d59a4c97-0478-4ad0-8895-22b583ab1f12 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:14.600349 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f96b5aaf-2bbd-4827-a6b2-68b00e7e7eab tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:14.600517 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d59a4c97-0478-4ad0-8895-22b583ab1f12 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:14.600929 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d59a4c97-0478-4ad0-8895-22b583ab1f12 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:14.601328 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d59a4c97-0478-4ad0-8895-22b583ab1f12 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:14.601572 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f96b5aaf-2bbd-4827-a6b2-68b00e7e7eab tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:14.602315 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f96b5aaf-2bbd-4827-a6b2-68b00e7e7eab tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:14.602782 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f96b5aaf-2bbd-4827-a6b2-68b00e7e7eab tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:14.603180 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f96b5aaf-2bbd-4827-a6b2-68b00e7e7eab tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:14.881429 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d59a4c97-0478-4ad0-8895-22b583ab1f12 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:14.889427 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d59a4c97-0478-4ad0-8895-22b583ab1f12 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0" status: 200 len: 1364 microversion: 2.1 time: 0.302886 Sep 12 23:57:14.890320 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 232/457] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:14 2022] GET /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0 => generated 1364 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:57:14.894124 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f96b5aaf-2bbd-4827-a6b2-68b00e7e7eab tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:14.905807 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f96b5aaf-2bbd-4827-a6b2-68b00e7e7eab tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735" status: 200 len: 1735 microversion: 2.1 time: 0.320563 Sep 12 23:57:14.906522 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 226/458] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:14 2022] GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735 => generated 1735 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:57:15.913329 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-34beb8a2-9fd7-4da6-982a-4eda18f21f82 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:15.913947 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-34beb8a2-9fd7-4da6-982a-4eda18f21f82 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: f1ff4faa-6a45-4d62-9e44-80dba7a947c0] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:15.921876 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-34beb8a2-9fd7-4da6-982a-4eda18f21f82 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:15.922529 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-34beb8a2-9fd7-4da6-982a-4eda18f21f82 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:15.923059 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-34beb8a2-9fd7-4da6-982a-4eda18f21f82 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:15.923961 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-34beb8a2-9fd7-4da6-982a-4eda18f21f82 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:15.924576 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-34beb8a2-9fd7-4da6-982a-4eda18f21f82 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:15.925293 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-34beb8a2-9fd7-4da6-982a-4eda18f21f82 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:15.930113 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8b06fb2d-5105-45a2-917f-dfbea5d929d8 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:15.930771 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-8b06fb2d-5105-45a2-917f-dfbea5d929d8 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 0be21a98-d3f6-4f26-8947-fd39015a7735] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:15.937740 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8b06fb2d-5105-45a2-917f-dfbea5d929d8 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:15.938288 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8b06fb2d-5105-45a2-917f-dfbea5d929d8 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:15.938796 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8b06fb2d-5105-45a2-917f-dfbea5d929d8 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:15.939614 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8b06fb2d-5105-45a2-917f-dfbea5d929d8 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:15.940233 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8b06fb2d-5105-45a2-917f-dfbea5d929d8 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:15.940715 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8b06fb2d-5105-45a2-917f-dfbea5d929d8 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:16.154244 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-34beb8a2-9fd7-4da6-982a-4eda18f21f82 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:16.158840 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8b06fb2d-5105-45a2-917f-dfbea5d929d8 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:16.166065 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-34beb8a2-9fd7-4da6-982a-4eda18f21f82 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0" status: 200 len: 1364 microversion: 2.1 time: 0.256562 Sep 12 23:57:16.166864 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 233/459] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:15 2022] GET /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0 => generated 1364 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:57:16.169543 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-8b06fb2d-5105-45a2-917f-dfbea5d929d8 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735" status: 200 len: 1735 microversion: 2.1 time: 0.243154 Sep 12 23:57:16.170164 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 227/460] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:15 2022] GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735 => generated 1735 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:57:17.191170 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-24479043-3dd8-4bb9-949c-68481ab6b989 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:17.191766 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-24479043-3dd8-4bb9-949c-68481ab6b989 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: f1ff4faa-6a45-4d62-9e44-80dba7a947c0] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:17.194039 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4e4f176a-cdca-416c-9fc5-353812f0a3d1 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:17.194650 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-4e4f176a-cdca-416c-9fc5-353812f0a3d1 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 0be21a98-d3f6-4f26-8947-fd39015a7735] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:17.198803 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-24479043-3dd8-4bb9-949c-68481ab6b989 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:17.199283 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-24479043-3dd8-4bb9-949c-68481ab6b989 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:17.199737 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-24479043-3dd8-4bb9-949c-68481ab6b989 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:17.200428 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-24479043-3dd8-4bb9-949c-68481ab6b989 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:17.200874 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-24479043-3dd8-4bb9-949c-68481ab6b989 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:17.201187 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4e4f176a-cdca-416c-9fc5-353812f0a3d1 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:17.201331 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-24479043-3dd8-4bb9-949c-68481ab6b989 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:17.201668 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4e4f176a-cdca-416c-9fc5-353812f0a3d1 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:17.202078 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4e4f176a-cdca-416c-9fc5-353812f0a3d1 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:17.202858 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4e4f176a-cdca-416c-9fc5-353812f0a3d1 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:17.203342 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4e4f176a-cdca-416c-9fc5-353812f0a3d1 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:17.203751 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4e4f176a-cdca-416c-9fc5-353812f0a3d1 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:17.409712 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-24479043-3dd8-4bb9-949c-68481ab6b989 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:17.413326 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4e4f176a-cdca-416c-9fc5-353812f0a3d1 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:17.419257 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-24479043-3dd8-4bb9-949c-68481ab6b989 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0" status: 200 len: 1364 microversion: 2.1 time: 0.231647 Sep 12 23:57:17.430308 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-4e4f176a-cdca-416c-9fc5-353812f0a3d1 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735" status: 200 len: 1735 microversion: 2.1 time: 0.240108 Sep 12 23:57:17.432650 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 228/461] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:17 2022] GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735 => generated 1735 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:57:17.432787 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 234/462] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:17 2022] GET /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0 => generated 1364 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:57:18.442382 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4c04f900-9eb8-4191-bf85-35e9b917d708 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:18.442971 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4c04f900-9eb8-4191-bf85-35e9b917d708 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: f1ff4faa-6a45-4d62-9e44-80dba7a947c0] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:18.444889 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell0:SELECT=2 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:57:18.445530 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell0:SELECT=10 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:57:18.451672 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell0:SELECT=2 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:57:18.452220 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4c04f900-9eb8-4191-bf85-35e9b917d708 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:18.452433 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4c04f900-9eb8-4191-bf85-35e9b917d708 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:18.452868 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4c04f900-9eb8-4191-bf85-35e9b917d708 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:18.453621 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4c04f900-9eb8-4191-bf85-35e9b917d708 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:18.454149 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4c04f900-9eb8-4191-bf85-35e9b917d708 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:18.454573 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4c04f900-9eb8-4191-bf85-35e9b917d708 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:18.456241 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-879a2991-7639-4cb0-b47b-f15eb88bacc9 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:18.456959 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-879a2991-7639-4cb0-b47b-f15eb88bacc9 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 0be21a98-d3f6-4f26-8947-fd39015a7735] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:18.463495 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-879a2991-7639-4cb0-b47b-f15eb88bacc9 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:18.463947 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-879a2991-7639-4cb0-b47b-f15eb88bacc9 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:18.464375 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-879a2991-7639-4cb0-b47b-f15eb88bacc9 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:18.465064 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-879a2991-7639-4cb0-b47b-f15eb88bacc9 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:18.465515 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-879a2991-7639-4cb0-b47b-f15eb88bacc9 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:18.465930 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-879a2991-7639-4cb0-b47b-f15eb88bacc9 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:18.655652 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4c04f900-9eb8-4191-bf85-35e9b917d708 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:18.659423 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-879a2991-7639-4cb0-b47b-f15eb88bacc9 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:18.664907 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4c04f900-9eb8-4191-bf85-35e9b917d708 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0" status: 200 len: 1364 microversion: 2.1 time: 0.226433 Sep 12 23:57:18.665556 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 235/463] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:18 2022] GET /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0 => generated 1364 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:57:18.668532 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-879a2991-7639-4cb0-b47b-f15eb88bacc9 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735" status: 200 len: 1735 microversion: 2.1 time: 0.218367 Sep 12 23:57:18.669180 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 229/464] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:18 2022] GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735 => generated 1735 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:57:19.497713 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-8d994bb4-3d71-48a8-bc1e-02fe23e36388 req-afa264ee-c802-4c32-82bd-fb36a461b05f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1ff4faa-6a45-4d62-9e44-80dba7a947c0", "name": "network-vif-plugged", "status": "completed", "tag": "cd5278d3-b6b8-4ed3-ba84-c102f2c6a074"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:57:19.508946 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-8d994bb4-3d71-48a8-bc1e-02fe23e36388 req-afa264ee-c802-4c32-82bd-fb36a461b05f service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:19.509430 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-8d994bb4-3d71-48a8-bc1e-02fe23e36388 req-afa264ee-c802-4c32-82bd-fb36a461b05f service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:19.509857 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-8d994bb4-3d71-48a8-bc1e-02fe23e36388 req-afa264ee-c802-4c32-82bd-fb36a461b05f service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:19.521424 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-8d994bb4-3d71-48a8-bc1e-02fe23e36388 req-afa264ee-c802-4c32-82bd-fb36a461b05f service nova] Creating event network-vif-plugged:cd5278d3-b6b8-4ed3-ba84-c102f2c6a074 for instance f1ff4faa-6a45-4d62-9e44-80dba7a947c0 on hv-cinder-82002 Sep 12 23:57:19.526855 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-8d994bb4-3d71-48a8-bc1e-02fe23e36388 req-afa264ee-c802-4c32-82bd-fb36a461b05f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033357 Sep 12 23:57:19.527684 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 236/465] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:57:19.689896 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-fe2ecef9-876c-4f17-a824-505022d8850e tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:19.690568 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-fe2ecef9-876c-4f17-a824-505022d8850e tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: f1ff4faa-6a45-4d62-9e44-80dba7a947c0] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:19.692359 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-6d089b06-c9f5-430b-b932-a4ef1627783d tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:19.693120 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-6d089b06-c9f5-430b-b932-a4ef1627783d tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 0be21a98-d3f6-4f26-8947-fd39015a7735] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:19.697317 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fe2ecef9-876c-4f17-a824-505022d8850e tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:19.697803 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fe2ecef9-876c-4f17-a824-505022d8850e tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:19.698250 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fe2ecef9-876c-4f17-a824-505022d8850e tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:19.699209 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fe2ecef9-876c-4f17-a824-505022d8850e tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:19.699831 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6d089b06-c9f5-430b-b932-a4ef1627783d tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:19.699967 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fe2ecef9-876c-4f17-a824-505022d8850e tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:19.700446 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fe2ecef9-876c-4f17-a824-505022d8850e tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:19.700899 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6d089b06-c9f5-430b-b932-a4ef1627783d tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:19.701562 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6d089b06-c9f5-430b-b932-a4ef1627783d tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:19.702366 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6d089b06-c9f5-430b-b932-a4ef1627783d tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:19.702796 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6d089b06-c9f5-430b-b932-a4ef1627783d tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:19.703245 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6d089b06-c9f5-430b-b932-a4ef1627783d tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:19.944204 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-fe2ecef9-876c-4f17-a824-505022d8850e tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:19.947095 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-6d089b06-c9f5-430b-b932-a4ef1627783d tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:19.952627 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-fe2ecef9-876c-4f17-a824-505022d8850e tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0" status: 200 len: 1364 microversion: 2.1 time: 0.266806 Sep 12 23:57:19.953595 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 230/466] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:19 2022] GET /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0 => generated 1364 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:57:19.956081 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-6d089b06-c9f5-430b-b932-a4ef1627783d tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735" status: 200 len: 1735 microversion: 2.1 time: 0.268040 Sep 12 23:57:19.956674 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 237/467] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:19 2022] GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735 => generated 1735 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:57:20.977493 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3bcfa767-0998-4bcc-b27d-45411cf3146b tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:20.978067 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3bcfa767-0998-4bcc-b27d-45411cf3146b tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: f1ff4faa-6a45-4d62-9e44-80dba7a947c0] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:20.979630 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-6f11b905-e2b7-45d5-bc5a-4652345f274a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:20.980281 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-6f11b905-e2b7-45d5-bc5a-4652345f274a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 0be21a98-d3f6-4f26-8947-fd39015a7735] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:20.984875 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3bcfa767-0998-4bcc-b27d-45411cf3146b tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:20.985362 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3bcfa767-0998-4bcc-b27d-45411cf3146b tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:20.985797 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3bcfa767-0998-4bcc-b27d-45411cf3146b tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:20.986502 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3bcfa767-0998-4bcc-b27d-45411cf3146b tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:20.986953 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3bcfa767-0998-4bcc-b27d-45411cf3146b tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:20.987181 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6f11b905-e2b7-45d5-bc5a-4652345f274a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:20.987393 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3bcfa767-0998-4bcc-b27d-45411cf3146b tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:20.987718 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6f11b905-e2b7-45d5-bc5a-4652345f274a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:20.988151 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6f11b905-e2b7-45d5-bc5a-4652345f274a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:20.988862 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6f11b905-e2b7-45d5-bc5a-4652345f274a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:20.989315 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6f11b905-e2b7-45d5-bc5a-4652345f274a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:20.989726 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6f11b905-e2b7-45d5-bc5a-4652345f274a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:21.179826 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3bcfa767-0998-4bcc-b27d-45411cf3146b tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:21.188538 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3bcfa767-0998-4bcc-b27d-45411cf3146b tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0" status: 200 len: 1364 microversion: 2.1 time: 0.215117 Sep 12 23:57:21.189246 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 231/468] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:20 2022] GET /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0 => generated 1364 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:57:21.192563 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-6f11b905-e2b7-45d5-bc5a-4652345f274a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:21.201779 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-6f11b905-e2b7-45d5-bc5a-4652345f274a tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735" status: 200 len: 1735 microversion: 2.1 time: 0.225836 Sep 12 23:57:21.202780 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 238/469] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:20 2022] GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735 => generated 1735 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:57:22.212946 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-90ef1b7b-226a-4065-a867-2606c5cb3fbf tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:22.213615 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-90ef1b7b-226a-4065-a867-2606c5cb3fbf tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: f1ff4faa-6a45-4d62-9e44-80dba7a947c0] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:22.221268 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-90ef1b7b-226a-4065-a867-2606c5cb3fbf tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:22.221807 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-90ef1b7b-226a-4065-a867-2606c5cb3fbf tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:22.222246 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-90ef1b7b-226a-4065-a867-2606c5cb3fbf tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:22.222972 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-90ef1b7b-226a-4065-a867-2606c5cb3fbf tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:22.223481 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-90ef1b7b-226a-4065-a867-2606c5cb3fbf tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:22.223905 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-90ef1b7b-226a-4065-a867-2606c5cb3fbf tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:22.227494 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-09609a97-6695-4506-be1f-bebb8317ad48 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:22.228547 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-09609a97-6695-4506-be1f-bebb8317ad48 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 0be21a98-d3f6-4f26-8947-fd39015a7735] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:22.236510 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-09609a97-6695-4506-be1f-bebb8317ad48 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:22.237238 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-09609a97-6695-4506-be1f-bebb8317ad48 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:22.237868 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-09609a97-6695-4506-be1f-bebb8317ad48 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:22.238740 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-09609a97-6695-4506-be1f-bebb8317ad48 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:22.239298 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-09609a97-6695-4506-be1f-bebb8317ad48 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:22.239849 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-09609a97-6695-4506-be1f-bebb8317ad48 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:22.447423 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-90ef1b7b-226a-4065-a867-2606c5cb3fbf tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:22.454337 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-09609a97-6695-4506-be1f-bebb8317ad48 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:22.455848 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-90ef1b7b-226a-4065-a867-2606c5cb3fbf tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0" status: 200 len: 1555 microversion: 2.1 time: 0.246887 Sep 12 23:57:22.456429 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 232/470] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:22 2022] GET /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0 => generated 1555 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:57:22.462918 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-09609a97-6695-4506-be1f-bebb8317ad48 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735" status: 200 len: 1735 microversion: 2.1 time: 0.240721 Sep 12 23:57:22.463531 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 239/471] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:22 2022] GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735 => generated 1735 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:57:22.478722 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-bad1a686-00d6-4230-a85f-5ba9a19493b6 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:22.479439 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-bad1a686-00d6-4230-a85f-5ba9a19493b6 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: f1ff4faa-6a45-4d62-9e44-80dba7a947c0] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:22.481939 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:57:22.489508 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bad1a686-00d6-4230-a85f-5ba9a19493b6 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:22.490263 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bad1a686-00d6-4230-a85f-5ba9a19493b6 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:22.490908 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bad1a686-00d6-4230-a85f-5ba9a19493b6 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:22.491947 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bad1a686-00d6-4230-a85f-5ba9a19493b6 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:22.492675 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bad1a686-00d6-4230-a85f-5ba9a19493b6 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:22.493361 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bad1a686-00d6-4230-a85f-5ba9a19493b6 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:22.578332 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-bad1a686-00d6-4230-a85f-5ba9a19493b6 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103553 Sep 12 23:57:22.578936 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 233/472] 10.222.0.26 () {58 vars in 1275 bytes} [Mon Sep 12 23:57:22 2022] GET /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:57:22.997306 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-383b6392-b2bb-428b-8c67-3ad3fef23e22 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:22.998190 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-383b6392-b2bb-428b-8c67-3ad3fef23e22 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:23.009099 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-383b6392-b2bb-428b-8c67-3ad3fef23e22 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:23.010017 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-383b6392-b2bb-428b-8c67-3ad3fef23e22 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:23.010788 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-383b6392-b2bb-428b-8c67-3ad3fef23e22 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:23.012092 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-383b6392-b2bb-428b-8c67-3ad3fef23e22 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:23.012903 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-383b6392-b2bb-428b-8c67-3ad3fef23e22 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:23.013666 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-383b6392-b2bb-428b-8c67-3ad3fef23e22 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:23.075021 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-383b6392-b2bb-428b-8c67-3ad3fef23e22 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65/os-volume_attachments/f13be105-d158-455e-854a-336b9be668e5" status: 200 len: 194 microversion: 2.20 time: 0.088451 Sep 12 23:57:23.075906 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 240/473] 10.222.0.26 () {60 vars in 1454 bytes} [Mon Sep 12 23:57:22 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65/os-volume_attachments/f13be105-d158-455e-854a-336b9be668e5 => generated 194 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 23:57:23.152891 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3ab9a67e-8ef1-415a-bba8-bd8d882d4406 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:23.153387 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3ab9a67e-8ef1-415a-bba8-bd8d882d4406 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:23.159716 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3ab9a67e-8ef1-415a-bba8-bd8d882d4406 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:23.160205 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3ab9a67e-8ef1-415a-bba8-bd8d882d4406 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:23.160642 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3ab9a67e-8ef1-415a-bba8-bd8d882d4406 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:23.161349 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3ab9a67e-8ef1-415a-bba8-bd8d882d4406 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:23.161805 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3ab9a67e-8ef1-415a-bba8-bd8d882d4406 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:23.162224 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3ab9a67e-8ef1-415a-bba8-bd8d882d4406 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:23.247404 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.objects.instance [None req-3ab9a67e-8ef1-415a-bba8-bd8d882d4406 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lazy-loading 'services' on Instance uuid 893ed869-802c-4a92-b7ab-d2aa8324fb65 {{(pid=126976) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 23:57:23.324069 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3ab9a67e-8ef1-415a-bba8-bd8d882d4406 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "DELETE /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65/os-volume_attachments/f13be105-d158-455e-854a-336b9be668e5" status: 202 len: 0 microversion: 2.20 time: 0.175405 Sep 12 23:57:23.324712 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 234/474] 10.222.0.26 () {60 vars in 1457 bytes} [Mon Sep 12 23:57:23 2022] DELETE /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65/os-volume_attachments/f13be105-d158-455e-854a-336b9be668e5 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 12 23:57:23.333356 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7c96066f-db2b-402f-a190-494aeaa83cca tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:23.335825 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7c96066f-db2b-402f-a190-494aeaa83cca tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:23.343324 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7c96066f-db2b-402f-a190-494aeaa83cca tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:23.343851 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7c96066f-db2b-402f-a190-494aeaa83cca tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:23.344643 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7c96066f-db2b-402f-a190-494aeaa83cca tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:23.345444 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7c96066f-db2b-402f-a190-494aeaa83cca tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:23.345999 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7c96066f-db2b-402f-a190-494aeaa83cca tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:23.346663 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7c96066f-db2b-402f-a190-494aeaa83cca tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:23.378920 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7c96066f-db2b-402f-a190-494aeaa83cca tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049512 Sep 12 23:57:23.379687 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 241/475] 10.222.0.26 () {60 vars in 1343 bytes} [Mon Sep 12 23:57:23 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 12 23:57:23.487021 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-965e0c36-7052-4d26-b35d-c6ee35ba8298 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:23.487754 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-965e0c36-7052-4d26-b35d-c6ee35ba8298 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 0be21a98-d3f6-4f26-8947-fd39015a7735] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:23.494158 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-965e0c36-7052-4d26-b35d-c6ee35ba8298 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:23.494642 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-965e0c36-7052-4d26-b35d-c6ee35ba8298 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:23.495070 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-965e0c36-7052-4d26-b35d-c6ee35ba8298 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:23.495791 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-965e0c36-7052-4d26-b35d-c6ee35ba8298 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:23.496242 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-965e0c36-7052-4d26-b35d-c6ee35ba8298 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:23.496671 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-965e0c36-7052-4d26-b35d-c6ee35ba8298 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:23.627667 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-94346708-784e-407b-a99f-5ac8b8f0fe97 req-ac597136-caa2-4988-8d2c-657d83631b61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1ff4faa-6a45-4d62-9e44-80dba7a947c0", "tag": "cd5278d3-b6b8-4ed3-ba84-c102f2c6a074"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:57:23.637787 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-94346708-784e-407b-a99f-5ac8b8f0fe97 req-ac597136-caa2-4988-8d2c-657d83631b61 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:23.638524 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-94346708-784e-407b-a99f-5ac8b8f0fe97 req-ac597136-caa2-4988-8d2c-657d83631b61 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:23.639169 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-94346708-784e-407b-a99f-5ac8b8f0fe97 req-ac597136-caa2-4988-8d2c-657d83631b61 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:23.651846 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-94346708-784e-407b-a99f-5ac8b8f0fe97 req-ac597136-caa2-4988-8d2c-657d83631b61 service nova] Creating event network-changed:cd5278d3-b6b8-4ed3-ba84-c102f2c6a074 for instance f1ff4faa-6a45-4d62-9e44-80dba7a947c0 on hv-cinder-82002 Sep 12 23:57:23.657083 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-94346708-784e-407b-a99f-5ac8b8f0fe97 req-ac597136-caa2-4988-8d2c-657d83631b61 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033298 Sep 12 23:57:23.658204 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 242/476] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:57:23.670704 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-965e0c36-7052-4d26-b35d-c6ee35ba8298 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:23.679250 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-965e0c36-7052-4d26-b35d-c6ee35ba8298 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735" status: 200 len: 1735 microversion: 2.1 time: 0.196760 Sep 12 23:57:23.680074 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 235/477] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:23 2022] GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735 => generated 1735 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:57:24.393808 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-13c893f0-0aa1-4e49-bb43-7f6bc91e231e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:24.396699 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-13c893f0-0aa1-4e49-bb43-7f6bc91e231e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:24.411369 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-13c893f0-0aa1-4e49-bb43-7f6bc91e231e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:24.411864 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-13c893f0-0aa1-4e49-bb43-7f6bc91e231e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:24.412310 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-13c893f0-0aa1-4e49-bb43-7f6bc91e231e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:24.413042 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-13c893f0-0aa1-4e49-bb43-7f6bc91e231e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:24.413682 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-13c893f0-0aa1-4e49-bb43-7f6bc91e231e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:24.414120 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-13c893f0-0aa1-4e49-bb43-7f6bc91e231e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:24.451674 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-13c893f0-0aa1-4e49-bb43-7f6bc91e231e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.062618 Sep 12 23:57:24.452753 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 243/478] 10.222.0.26 () {60 vars in 1343 bytes} [Mon Sep 12 23:57:24 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:57:24.527928 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-bfc8b82d-8d1a-48f5-bb4f-343da87a8ba1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:24.528997 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-bfc8b82d-8d1a-48f5-bb4f-343da87a8ba1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:24.537830 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bfc8b82d-8d1a-48f5-bb4f-343da87a8ba1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:24.538327 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bfc8b82d-8d1a-48f5-bb4f-343da87a8ba1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:24.538758 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bfc8b82d-8d1a-48f5-bb4f-343da87a8ba1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:24.539541 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bfc8b82d-8d1a-48f5-bb4f-343da87a8ba1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:24.540170 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bfc8b82d-8d1a-48f5-bb4f-343da87a8ba1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:24.540600 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bfc8b82d-8d1a-48f5-bb4f-343da87a8ba1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:24.570138 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-bfc8b82d-8d1a-48f5-bb4f-343da87a8ba1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Going to try to terminate instance {{(pid=126976) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 23:57:24.679477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-bfc8b82d-8d1a-48f5-bb4f-343da87a8ba1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "DELETE /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 204 len: 0 microversion: 2.20 time: 0.154989 Sep 12 23:57:24.680771 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 236/479] 10.222.0.26 () {60 vars in 1280 bytes} [Mon Sep 12 23:57:24 2022] DELETE /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 12 23:57:24.694003 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5ea8d8ca-6469-4278-9ad9-99a9ada6b45c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:24.694614 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5ea8d8ca-6469-4278-9ad9-99a9ada6b45c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:24.701433 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5ea8d8ca-6469-4278-9ad9-99a9ada6b45c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:24.701964 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5ea8d8ca-6469-4278-9ad9-99a9ada6b45c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:24.702399 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5ea8d8ca-6469-4278-9ad9-99a9ada6b45c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:24.703114 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5ea8d8ca-6469-4278-9ad9-99a9ada6b45c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:24.703593 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5ea8d8ca-6469-4278-9ad9-99a9ada6b45c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:24.704013 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5ea8d8ca-6469-4278-9ad9-99a9ada6b45c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:24.704303 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3575a77b-9cfb-462c-a6b2-eae76250db3b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:24.705023 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3575a77b-9cfb-462c-a6b2-eae76250db3b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 0be21a98-d3f6-4f26-8947-fd39015a7735] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:24.713014 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3575a77b-9cfb-462c-a6b2-eae76250db3b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:24.713516 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3575a77b-9cfb-462c-a6b2-eae76250db3b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:24.713955 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3575a77b-9cfb-462c-a6b2-eae76250db3b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:24.714681 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3575a77b-9cfb-462c-a6b2-eae76250db3b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:24.715145 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3575a77b-9cfb-462c-a6b2-eae76250db3b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:24.715601 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3575a77b-9cfb-462c-a6b2-eae76250db3b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:24.922350 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5ea8d8ca-6469-4278-9ad9-99a9ada6b45c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:24.931437 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5ea8d8ca-6469-4278-9ad9-99a9ada6b45c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:24.932886 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5ea8d8ca-6469-4278-9ad9-99a9ada6b45c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:24.934159 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5ea8d8ca-6469-4278-9ad9-99a9ada6b45c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1725 microversion: 2.20 time: 0.246397 Sep 12 23:57:24.935585 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 244/480] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:57:24 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1725 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:57:24.948417 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3575a77b-9cfb-462c-a6b2-eae76250db3b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:24.950875 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:57:24.959055 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3575a77b-9cfb-462c-a6b2-eae76250db3b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735" status: 200 len: 1735 microversion: 2.1 time: 0.259007 Sep 12 23:57:24.959654 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 237/481] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:24 2022] GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735 => generated 1735 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:57:25.964318 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1b0082db-c559-44d0-bf49-d716e6b374e7 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:25.964891 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1b0082db-c559-44d0-bf49-d716e6b374e7 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:25.971911 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1b0082db-c559-44d0-bf49-d716e6b374e7 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:25.972417 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1b0082db-c559-44d0-bf49-d716e6b374e7 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:25.972834 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1b0082db-c559-44d0-bf49-d716e6b374e7 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:25.973540 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1b0082db-c559-44d0-bf49-d716e6b374e7 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:25.973991 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1b0082db-c559-44d0-bf49-d716e6b374e7 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:25.974412 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1b0082db-c559-44d0-bf49-d716e6b374e7 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:25.982393 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-60306e75-e3ed-447d-8089-133339370580 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:25.983102 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-60306e75-e3ed-447d-8089-133339370580 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 0be21a98-d3f6-4f26-8947-fd39015a7735] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:25.991024 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-60306e75-e3ed-447d-8089-133339370580 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:25.991506 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-60306e75-e3ed-447d-8089-133339370580 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:25.991955 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-60306e75-e3ed-447d-8089-133339370580 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:25.992666 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-60306e75-e3ed-447d-8089-133339370580 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:25.993200 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-60306e75-e3ed-447d-8089-133339370580 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:25.993573 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-60306e75-e3ed-447d-8089-133339370580 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:26.446608 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-1b0082db-c559-44d0-bf49-d716e6b374e7 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:26.448989 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:57:26.456993 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-1b0082db-c559-44d0-bf49-d716e6b374e7 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:26.458448 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-1b0082db-c559-44d0-bf49-d716e6b374e7 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:26.459645 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1b0082db-c559-44d0-bf49-d716e6b374e7 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1725 microversion: 2.20 time: 0.499587 Sep 12 23:57:26.470698 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 245/482] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:57:25 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1725 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:57:26.480027 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-60306e75-e3ed-447d-8089-133339370580 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:26.489933 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-60306e75-e3ed-447d-8089-133339370580 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735" status: 200 len: 1735 microversion: 2.1 time: 0.511331 Sep 12 23:57:26.490551 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 238/483] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:25 2022] GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735 => generated 1735 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:57:27.364795 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-cebe4c67-5a71-49e6-a6cc-fa4f2e75a312 req-b1dced3f-33e6-40b8-ba76-f8fe865df374 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "893ed869-802c-4a92-b7ab-d2aa8324fb65", "name": "network-vif-deleted", "tag": "3a5cf7e7-3d44-4786-8d75-99e5d72ef0e0"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:57:27.376104 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-cebe4c67-5a71-49e6-a6cc-fa4f2e75a312 req-b1dced3f-33e6-40b8-ba76-f8fe865df374 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:27.376788 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-cebe4c67-5a71-49e6-a6cc-fa4f2e75a312 req-b1dced3f-33e6-40b8-ba76-f8fe865df374 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:27.377211 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-cebe4c67-5a71-49e6-a6cc-fa4f2e75a312 req-b1dced3f-33e6-40b8-ba76-f8fe865df374 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:27.389658 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-cebe4c67-5a71-49e6-a6cc-fa4f2e75a312 req-b1dced3f-33e6-40b8-ba76-f8fe865df374 service nova] Creating event network-vif-deleted:3a5cf7e7-3d44-4786-8d75-99e5d72ef0e0 for instance 893ed869-802c-4a92-b7ab-d2aa8324fb65 on hv-cinder-82002 Sep 12 23:57:27.396138 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-cebe4c67-5a71-49e6-a6cc-fa4f2e75a312 req-b1dced3f-33e6-40b8-ba76-f8fe865df374 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035236 Sep 12 23:57:27.396782 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 246/484] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:57:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:57:27.487732 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7b511429-118a-4d30-b6a3-e37ee0cab4c8 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:27.489875 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7b511429-118a-4d30-b6a3-e37ee0cab4c8 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:27.499937 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7b511429-118a-4d30-b6a3-e37ee0cab4c8 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:27.501068 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7b511429-118a-4d30-b6a3-e37ee0cab4c8 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:27.501748 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7b511429-118a-4d30-b6a3-e37ee0cab4c8 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:27.507074 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7b511429-118a-4d30-b6a3-e37ee0cab4c8 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:27.508014 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7b511429-118a-4d30-b6a3-e37ee0cab4c8 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:27.508618 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7b511429-118a-4d30-b6a3-e37ee0cab4c8 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:27.515033 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-00d57fd6-3885-4cba-8524-46d436f1e16b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:27.516099 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-00d57fd6-3885-4cba-8524-46d436f1e16b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 0be21a98-d3f6-4f26-8947-fd39015a7735] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:27.524009 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-00d57fd6-3885-4cba-8524-46d436f1e16b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:27.524796 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-00d57fd6-3885-4cba-8524-46d436f1e16b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:27.525417 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-00d57fd6-3885-4cba-8524-46d436f1e16b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:27.526598 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-00d57fd6-3885-4cba-8524-46d436f1e16b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:27.527250 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-00d57fd6-3885-4cba-8524-46d436f1e16b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:27.527861 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-00d57fd6-3885-4cba-8524-46d436f1e16b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:27.661601 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7b511429-118a-4d30-b6a3-e37ee0cab4c8 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:27.671154 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7b511429-118a-4d30-b6a3-e37ee0cab4c8 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:27.672796 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7b511429-118a-4d30-b6a3-e37ee0cab4c8 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:27.674297 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7b511429-118a-4d30-b6a3-e37ee0cab4c8 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1657 microversion: 2.20 time: 0.192363 Sep 12 23:57:27.674892 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 239/485] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:57:27 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1657 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:57:27.775407 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-00d57fd6-3885-4cba-8524-46d436f1e16b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:27.785360 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-00d57fd6-3885-4cba-8524-46d436f1e16b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735" status: 200 len: 1735 microversion: 2.1 time: 0.275136 Sep 12 23:57:27.786063 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 247/486] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:27 2022] GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735 => generated 1735 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:57:28.704365 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-dec4784c-a5ea-4b9e-b218-4053c7926618 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:28.704920 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-dec4784c-a5ea-4b9e-b218-4053c7926618 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:28.712079 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dec4784c-a5ea-4b9e-b218-4053c7926618 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:28.712835 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dec4784c-a5ea-4b9e-b218-4053c7926618 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:28.713265 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dec4784c-a5ea-4b9e-b218-4053c7926618 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:28.713953 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dec4784c-a5ea-4b9e-b218-4053c7926618 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:28.714398 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dec4784c-a5ea-4b9e-b218-4053c7926618 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:28.714826 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dec4784c-a5ea-4b9e-b218-4053c7926618 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:28.750776 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dec4784c-a5ea-4b9e-b218-4053c7926618 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:28.751290 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dec4784c-a5ea-4b9e-b218-4053c7926618 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:28.751731 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dec4784c-a5ea-4b9e-b218-4053c7926618 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:28.752175 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.objects.instance [None req-dec4784c-a5ea-4b9e-b218-4053c7926618 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lazy-loading 'fault' on Instance uuid 893ed869-802c-4a92-b7ab-d2aa8324fb65 {{(pid=126976) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 23:57:28.797550 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-dec4784c-a5ea-4b9e-b218-4053c7926618 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:28.806800 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-dec4784c-a5ea-4b9e-b218-4053c7926618 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:28.808295 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-dec4784c-a5ea-4b9e-b218-4053c7926618 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:28.809333 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e50c8ce3-f08b-4f02-964b-4d5ab725a680 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:28.809794 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-dec4784c-a5ea-4b9e-b218-4053c7926618 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1372 microversion: 2.20 time: 0.110977 Sep 12 23:57:28.809958 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e50c8ce3-f08b-4f02-964b-4d5ab725a680 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 0be21a98-d3f6-4f26-8947-fd39015a7735] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:28.810073 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 240/487] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:57:28 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1372 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:57:28.817038 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e50c8ce3-f08b-4f02-964b-4d5ab725a680 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:28.817872 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e50c8ce3-f08b-4f02-964b-4d5ab725a680 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:28.818136 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e50c8ce3-f08b-4f02-964b-4d5ab725a680 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:28.818976 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e50c8ce3-f08b-4f02-964b-4d5ab725a680 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:28.819472 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e50c8ce3-f08b-4f02-964b-4d5ab725a680 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:28.819863 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e50c8ce3-f08b-4f02-964b-4d5ab725a680 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:28.970026 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e50c8ce3-f08b-4f02-964b-4d5ab725a680 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:28.979460 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e50c8ce3-f08b-4f02-964b-4d5ab725a680 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735" status: 200 len: 1735 microversion: 2.1 time: 0.173959 Sep 12 23:57:28.980132 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 248/488] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:28 2022] GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735 => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:57:29.837910 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-71a2cb9a-21e8-412f-8173-07e9633d58f2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:29.840146 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-71a2cb9a-21e8-412f-8173-07e9633d58f2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:29.851492 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-71a2cb9a-21e8-412f-8173-07e9633d58f2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:29.852901 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-71a2cb9a-21e8-412f-8173-07e9633d58f2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:29.852901 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-71a2cb9a-21e8-412f-8173-07e9633d58f2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:29.853157 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-71a2cb9a-21e8-412f-8173-07e9633d58f2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:29.853738 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-71a2cb9a-21e8-412f-8173-07e9633d58f2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:29.854179 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-71a2cb9a-21e8-412f-8173-07e9633d58f2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:29.896959 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-71a2cb9a-21e8-412f-8173-07e9633d58f2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:29.896959 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-71a2cb9a-21e8-412f-8173-07e9633d58f2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:29.897398 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-71a2cb9a-21e8-412f-8173-07e9633d58f2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:29.897854 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.objects.instance [None req-71a2cb9a-21e8-412f-8173-07e9633d58f2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lazy-loading 'fault' on Instance uuid 893ed869-802c-4a92-b7ab-d2aa8324fb65 {{(pid=126976) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 23:57:29.940155 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-71a2cb9a-21e8-412f-8173-07e9633d58f2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:29.948271 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-71a2cb9a-21e8-412f-8173-07e9633d58f2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:29.949699 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-71a2cb9a-21e8-412f-8173-07e9633d58f2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:29.950855 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-71a2cb9a-21e8-412f-8173-07e9633d58f2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 200 len: 1372 microversion: 2.20 time: 0.119453 Sep 12 23:57:29.951480 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 241/489] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:57:29 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 1372 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:57:30.005078 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-50678510-cecd-44e5-9f5c-7ee304a1d41f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:30.005655 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-50678510-cecd-44e5-9f5c-7ee304a1d41f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 0be21a98-d3f6-4f26-8947-fd39015a7735] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:30.012480 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-50678510-cecd-44e5-9f5c-7ee304a1d41f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:30.012965 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-50678510-cecd-44e5-9f5c-7ee304a1d41f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:30.013403 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-50678510-cecd-44e5-9f5c-7ee304a1d41f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:30.014101 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-50678510-cecd-44e5-9f5c-7ee304a1d41f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:30.014554 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-50678510-cecd-44e5-9f5c-7ee304a1d41f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:30.014979 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-50678510-cecd-44e5-9f5c-7ee304a1d41f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:30.157810 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-50678510-cecd-44e5-9f5c-7ee304a1d41f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:30.166418 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-50678510-cecd-44e5-9f5c-7ee304a1d41f tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735" status: 200 len: 1715 microversion: 2.1 time: 0.165431 Sep 12 23:57:30.166990 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 249/490] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:29 2022] GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735 => generated 1715 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:57:30.234382 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-90be7819-2bc2-4db0-8dc8-8373c0befd06 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:30.235013 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-90be7819-2bc2-4db0-8dc8-8373c0befd06 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 0be21a98-d3f6-4f26-8947-fd39015a7735] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:30.241477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-90be7819-2bc2-4db0-8dc8-8373c0befd06 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:30.241969 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-90be7819-2bc2-4db0-8dc8-8373c0befd06 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:30.242402 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-90be7819-2bc2-4db0-8dc8-8373c0befd06 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:30.243109 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-90be7819-2bc2-4db0-8dc8-8373c0befd06 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:30.243593 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-90be7819-2bc2-4db0-8dc8-8373c0befd06 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:30.244014 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-90be7819-2bc2-4db0-8dc8-8373c0befd06 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:30.332408 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-90be7819-2bc2-4db0-8dc8-8373c0befd06 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] HTTP exception thrown: Cannot 'detach_volume' instance 0be21a98-d3f6-4f26-8947-fd39015a7735 while it is in vm_state rescued Sep 12 23:57:30.334048 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-90be7819-2bc2-4db0-8dc8-8373c0befd06 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Request method failure captured: Sep 12 23:57:30.334048 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: request: DELETE /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735/os-volume_attachments/ed40638a-976a-4031-9703-eea367213210 HTTP/1.1 Sep 12 23:57:30.334048 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Accept: application/json Sep 12 23:57:30.334048 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Sep 12 23:57:30.334048 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Connection: close Sep 12 23:57:30.334048 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Content-Length: 0 Sep 12 23:57:30.334048 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Content-Type: application/json Sep 12 23:57:30.334048 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Host: 10.222.0.26 Sep 12 23:57:30.334048 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Sep 12 23:57:30.334048 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Sep 12 23:57:30.334048 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjH8ZuStW1XXoPQe5y95eOpKYZF0F7YBvJw_27e2kYLBySngK1oyC8cbK16WrSBBy5I-zldm72baODkX7E0kbSH3YQJRovD2YiBAj_9m-miREAelhxMrO-4StKyBWO2wiypQKnAsHCgsduOcFVztxSrPSWmh7ZuLOXLc3LDIycAkgHl0E Sep 12 23:57:30.334048 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Sep 12 23:57:30.334048 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Sep 12 23:57:30.334048 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Sep 12 23:57:30.334048 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Sep 12 23:57:30.334048 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Sep 12 23:57:30.334048 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Sep 12 23:57:30.334048 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Id: 6c458cf41ded4113a09fb07e10d81d39 Sep 12 23:57:30.334048 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2096714212 Sep 12 23:57:30.334048 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Role: member,reader Sep 12 23:57:30.334048 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Roles: member,reader Sep 12 23:57:30.336693 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6c458cf41ded4113a09fb07e10d81d39"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6c458cf41ded4113a09fb07e10d81d39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6c458cf41ded4113a09fb07e10d81d39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6c458cf41ded4113a09fb07e10d81d39"}]}] Sep 12 23:57:30.336693 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2096714212 Sep 12 23:57:30.336693 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant-Id: 6c458cf41ded4113a09fb07e10d81d39 Sep 12 23:57:30.336693 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2096714212 Sep 12 23:57:30.336693 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User: tempest-ServerRescueNegativeTestJSON-2096714212-project Sep 12 23:57:30.336693 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Sep 12 23:57:30.336693 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Sep 12 23:57:30.336693 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Id: 76eb39c2010e43aaa0a01caaea3a38b9 Sep 12 23:57:30.336693 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2096714212-project Sep 12 23:57:30.336693 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: method: > Sep 12 23:57:30.336693 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: exception: Cannot 'detach_volume' instance 0be21a98-d3f6-4f26-8947-fd39015a7735 while it is in vm_state rescued Sep 12 23:57:30.337977 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: action_args: {'server_id': '0be21a98-d3f6-4f26-8947-fd39015a7735', 'id': 'ed40638a-976a-4031-9703-eea367213210'} Sep 12 23:57:30.337977 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:57:30.337977 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:57:30.337977 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 12 23:57:30.337977 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 12 23:57:30.337977 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 12 23:57:30.337977 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 12 23:57:30.337977 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 12 23:57:30.337977 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 12 23:57:30.337977 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0be21a98-d3f6-4f26-8947-fd39015a7735 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 12 23:57:30.337977 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:57:30.337977 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:57:30.337977 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:57:30.337977 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:57:30.337977 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:57:30.337977 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:57:30.337977 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:57:30.337977 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:57:30.337977 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:57:30.337977 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:57:30.340330 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 12 23:57:30.340330 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 12 23:57:30.340330 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 12 23:57:30.340330 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 12 23:57:30.340330 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 0be21a98-d3f6-4f26-8947-fd39015a7735 while it is in vm_state rescued Sep 12 23:57:30.340330 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:57:30.340330 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:57:30.340330 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:57:30.340330 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:57:30.340330 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:57:30.340330 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:57:30.340330 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:57:30.340330 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:57:30.340330 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 0be21a98-d3f6-4f26-8947-fd39015a7735 while it is in vm_state rescued Sep 12 23:57:30.340330 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:57:30.340330 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-90be7819-2bc2-4db0-8dc8-8373c0befd06 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Returning 409 to user: Cannot 'detach_volume' instance 0be21a98-d3f6-4f26-8947-fd39015a7735 while it is in vm_state rescued {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:57:30.342204 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-90be7819-2bc2-4db0-8dc8-8373c0befd06 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735/os-volume_attachments/ed40638a-976a-4031-9703-eea367213210" status: 409 len: 152 microversion: 2.1 time: 0.105498 Sep 12 23:57:30.342204 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 242/491] 10.222.0.26 () {58 vars in 1416 bytes} [Mon Sep 12 23:57:30 2022] DELETE /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735/os-volume_attachments/ed40638a-976a-4031-9703-eea367213210 => generated 152 bytes in 110 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 12 23:57:30.348601 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b2f719f9-60e7-4730-baf7-535af5b79eab tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:57:30.349561 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b2f719f9-60e7-4730-baf7-535af5b79eab tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 0be21a98-d3f6-4f26-8947-fd39015a7735] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:30.360693 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b2f719f9-60e7-4730-baf7-535af5b79eab tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:30.361511 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b2f719f9-60e7-4730-baf7-535af5b79eab tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:30.362537 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b2f719f9-60e7-4730-baf7-535af5b79eab tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:30.364108 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b2f719f9-60e7-4730-baf7-535af5b79eab tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:30.365155 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b2f719f9-60e7-4730-baf7-535af5b79eab tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:30.366165 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b2f719f9-60e7-4730-baf7-535af5b79eab tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:30.464964 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b2f719f9-60e7-4730-baf7-535af5b79eab tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "POST /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735/action" status: 202 len: 0 microversion: 2.1 time: 0.123311 Sep 12 23:57:30.465603 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 250/492] 10.222.0.26 () {60 vars in 1278 bytes} [Mon Sep 12 23:57:30 2022] POST /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 12 23:57:30.474120 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f650c62e-1d8c-42a4-93b6-2d3d57775321 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:30.474741 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f650c62e-1d8c-42a4-93b6-2d3d57775321 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 0be21a98-d3f6-4f26-8947-fd39015a7735] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:30.481020 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f650c62e-1d8c-42a4-93b6-2d3d57775321 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:30.481509 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f650c62e-1d8c-42a4-93b6-2d3d57775321 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:30.481942 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f650c62e-1d8c-42a4-93b6-2d3d57775321 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:30.482645 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f650c62e-1d8c-42a4-93b6-2d3d57775321 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:30.483106 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f650c62e-1d8c-42a4-93b6-2d3d57775321 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:30.483555 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f650c62e-1d8c-42a4-93b6-2d3d57775321 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:30.720385 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f650c62e-1d8c-42a4-93b6-2d3d57775321 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:30.729561 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f650c62e-1d8c-42a4-93b6-2d3d57775321 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735" status: 200 len: 1723 microversion: 2.1 time: 0.259229 Sep 12 23:57:30.730154 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 243/493] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:30 2022] GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735 => generated 1723 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:57:30.977833 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5dc056c9-c90e-477a-a714-d939f43c6966 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:30.978553 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5dc056c9-c90e-477a-a714-d939f43c6966 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:30.985916 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5dc056c9-c90e-477a-a714-d939f43c6966 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:30.986406 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5dc056c9-c90e-477a-a714-d939f43c6966 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:30.986824 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5dc056c9-c90e-477a-a714-d939f43c6966 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:30.987606 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5dc056c9-c90e-477a-a714-d939f43c6966 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:30.988062 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5dc056c9-c90e-477a-a714-d939f43c6966 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:30.988478 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5dc056c9-c90e-477a-a714-d939f43c6966 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:31.002851 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-5dc056c9-c90e-477a-a714-d939f43c6966 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] HTTP exception thrown: Instance 893ed869-802c-4a92-b7ab-d2aa8324fb65 could not be found. Sep 12 23:57:31.004536 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5dc056c9-c90e-477a-a714-d939f43c6966 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Request method failure captured: Sep 12 23:57:31.004536 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: request: GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 HTTP/1.1 Sep 12 23:57:31.004536 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept: application/json Sep 12 23:57:31.004536 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Sep 12 23:57:31.004536 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Connection: close Sep 12 23:57:31.004536 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Length: 0 Sep 12 23:57:31.004536 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Type: application/json Sep 12 23:57:31.004536 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Host: 10.222.0.26 Sep 12 23:57:31.004536 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Sep 12 23:57:31.004536 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Sep 12 23:57:31.004536 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjH8ZzAZBJpVEa5OR-IWoXlXYL0GuBqrJSVm_QRjmnskUPrxkjni-j-imzFjCx61W-2-_IDrOSxj7B1Hx4rUd1feLPlScBV0O7d5sdYxQlKDGnDX7yzSfaJN20gjNVn3GVaRtOyngD8LHmRpGHp7346Gx8ARU2ju8xnZq9P_ENjF7DvL0 Sep 12 23:57:31.004536 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Sep 12 23:57:31.004536 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Sep 12 23:57:31.004536 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Sep 12 23:57:31.004536 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Sep 12 23:57:31.004536 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Openstack-Nova-Api-Version: 2.20 Sep 12 23:57:31.004536 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Sep 12 23:57:31.004536 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Sep 12 23:57:31.004536 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Id: 6b2f385a651c408bb9d32b5c4e1ab6ff Sep 12 23:57:31.004536 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-895466941 Sep 12 23:57:31.004536 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Role: member,reader Sep 12 23:57:31.004536 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Roles: member,reader Sep 12 23:57:31.006372 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6b2f385a651c408bb9d32b5c4e1ab6ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6b2f385a651c408bb9d32b5c4e1ab6ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6b2f385a651c408bb9d32b5c4e1ab6ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6b2f385a651c408bb9d32b5c4e1ab6ff"}]}] Sep 12 23:57:31.006372 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-AttachVolumeShelveTestJSON-895466941 Sep 12 23:57:31.006372 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Id: 6b2f385a651c408bb9d32b5c4e1ab6ff Sep 12 23:57:31.006372 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-895466941 Sep 12 23:57:31.006372 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User: tempest-AttachVolumeShelveTestJSON-895466941-project Sep 12 23:57:31.006372 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Sep 12 23:57:31.006372 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Sep 12 23:57:31.006372 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Id: 296f02c73fc548969bf60df4f8f372b0 Sep 12 23:57:31.006372 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-AttachVolumeShelveTestJSON-895466941-project Sep 12 23:57:31.006372 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: method: > Sep 12 23:57:31.006372 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: exception: Instance 893ed869-802c-4a92-b7ab-d2aa8324fb65 could not be found. Sep 12 23:57:31.006372 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: action_args: {'id': '893ed869-802c-4a92-b7ab-d2aa8324fb65'} Sep 12 23:57:31.007113 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:57:31.007113 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:57:31.007113 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:57:31.007113 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:57:31.007113 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:57:31.007113 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:57:31.007113 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:57:31.007113 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:57:31.007113 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:57:31.007113 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:57:31.007113 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 893ed869-802c-4a92-b7ab-d2aa8324fb65 could not be found. Sep 12 23:57:31.007113 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:57:31.007113 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:57:31.007113 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:57:31.007113 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:57:31.007113 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:57:31.007113 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:57:31.007113 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:57:31.007113 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:57:31.007113 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:57:31.008359 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:57:31.008359 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 23:57:31.008359 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 23:57:31.008359 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:57:31.008359 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:57:31.008359 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:57:31.008359 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:57:31.008359 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 893ed869-802c-4a92-b7ab-d2aa8324fb65 could not be found. Sep 12 23:57:31.008359 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:57:31.008359 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:57:31.008359 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:57:31.008359 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:57:31.008359 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:57:31.008359 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:57:31.008359 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:57:31.008359 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:57:31.008359 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 893ed869-802c-4a92-b7ab-d2aa8324fb65 could not be found. Sep 12 23:57:31.008359 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:57:31.009445 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5dc056c9-c90e-477a-a714-d939f43c6966 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Returning 404 to user: Instance 893ed869-802c-4a92-b7ab-d2aa8324fb65 could not be found. {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:57:31.009445 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5dc056c9-c90e-477a-a714-d939f43c6966 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 404 len: 111 microversion: 2.20 time: 0.032551 Sep 12 23:57:31.009445 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 251/494] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:57:30 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 12 23:57:31.015435 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-58182554-b573-480d-8ad3-81d84bc6f096 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '.version_select at 0x7fed013dbc10>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:31.039901 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-58182554-b573-480d-8ad3-81d84bc6f096 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1902538849" status: 204 len: 0 microversion: 2.20 time: 0.028390 Sep 12 23:57:31.040578 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 244/495] 10.222.0.26 () {60 vars in 1262 bytes} [Mon Sep 12 23:57:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1902538849 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 12 23:57:31.722944 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7452cfa0-3922-465d-9278-7346bef45cda tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Action: 'create', calling method: .version_select at 0x7fed01537160>, body: {"keypair": {"name": "tempest-keypair-487791268", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN9/ZeHNvxzm1nYpWLBbdk+AVchLBites9IFboQRxdiFmEQJ1wN/IRCJdxujFjMIGsKp1gP+cZimyRbnbtkIqHSPjD2S8bfC7pq024mHFPGPQCNHQOTs2PbZogGYwgkFbw=="}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:57:31.739083 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-7452cfa0-3922-465d-9278-7346bef45cda tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Getting quotas for project 6b2f385a651c408bb9d32b5c4e1ab6ff. Resources: {'key_pairs'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 23:57:31.743153 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-7452cfa0-3922-465d-9278-7346bef45cda tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Getting quotas for user 296f02c73fc548969bf60df4f8f372b0 and project 6b2f385a651c408bb9d32b5c4e1ab6ff. Resources: {'key_pairs'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 23:57:31.754355 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c7b0f466-9af9-4705-8165-705a0abf56be tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:31.755015 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c7b0f466-9af9-4705-8165-705a0abf56be tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 0be21a98-d3f6-4f26-8947-fd39015a7735] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:31.762179 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c7b0f466-9af9-4705-8165-705a0abf56be tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:31.762745 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c7b0f466-9af9-4705-8165-705a0abf56be tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:31.763727 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c7b0f466-9af9-4705-8165-705a0abf56be tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:31.764622 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c7b0f466-9af9-4705-8165-705a0abf56be tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:31.765026 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c7b0f466-9af9-4705-8165-705a0abf56be tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:31.765502 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c7b0f466-9af9-4705-8165-705a0abf56be tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:31.772526 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7452cfa0-3922-465d-9278-7346bef45cda tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.053423 Sep 12 23:57:31.773100 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 252/496] 10.222.0.26 () {62 vars in 1200 bytes} [Mon Sep 12 23:57:31 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 55 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 12 23:57:31.920963 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c7b0f466-9af9-4705-8165-705a0abf56be tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:31.938576 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c7b0f466-9af9-4705-8165-705a0abf56be tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735" status: 200 len: 1723 microversion: 2.1 time: 0.188595 Sep 12 23:57:31.942699 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 245/497] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:31 2022] GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:57:32.979016 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e50a48f4-ffd2-4a1a-90bd-061c3f607a8d tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:32.979693 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e50a48f4-ffd2-4a1a-90bd-061c3f607a8d tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 0be21a98-d3f6-4f26-8947-fd39015a7735] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:32.987397 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e50a48f4-ffd2-4a1a-90bd-061c3f607a8d tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:32.987989 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e50a48f4-ffd2-4a1a-90bd-061c3f607a8d tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:32.988438 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e50a48f4-ffd2-4a1a-90bd-061c3f607a8d tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:32.989190 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e50a48f4-ffd2-4a1a-90bd-061c3f607a8d tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:32.989655 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e50a48f4-ffd2-4a1a-90bd-061c3f607a8d tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:32.990083 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e50a48f4-ffd2-4a1a-90bd-061c3f607a8d tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:33.152565 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e50a48f4-ffd2-4a1a-90bd-061c3f607a8d tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:33.163621 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e50a48f4-ffd2-4a1a-90bd-061c3f607a8d tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735" status: 200 len: 1723 microversion: 2.1 time: 0.188917 Sep 12 23:57:33.164576 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 253/498] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:32 2022] GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:57:33.346087 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a35e3fc0-b1b1-4dd6-8c3f-aa2dcc66c27e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1374249699", "imageRef": "22a47167-5e04-441a-a504-d76d82afc776", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "44934c4b-e07a-4c1a-9ac8-ec89467058c7"}], "security_groups": [{"name": "tempest-securitygroup--1651106384"}], "key_name": "tempest-keypair-487791268", "user_data": "}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:57:33.469848 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.network.neutron [None req-a35e3fc0-b1b1-4dd6-8c3f-aa2dcc66c27e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] validate_networks() for [('44934c4b-e07a-4c1a-9ac8-ec89467058c7', None, None, None, None, None)] {{(pid=126976) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 23:57:33.882338 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-a35e3fc0-b1b1-4dd6-8c3f-aa2dcc66c27e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Flavor limits 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 23:57:33.882751 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-a35e3fc0-b1b1-4dd6-8c3f-aa2dcc66c27e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Image limits 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 23:57:33.883211 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-a35e3fc0-b1b1-4dd6-8c3f-aa2dcc66c27e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Flavor pref 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 23:57:33.883646 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-a35e3fc0-b1b1-4dd6-8c3f-aa2dcc66c27e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Image pref 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 23:57:33.884046 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-a35e3fc0-b1b1-4dd6-8c3f-aa2dcc66c27e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 23:57:33.893030 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a35e3fc0-b1b1-4dd6-8c3f-aa2dcc66c27e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:33.893503 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a35e3fc0-b1b1-4dd6-8c3f-aa2dcc66c27e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:33.893924 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a35e3fc0-b1b1-4dd6-8c3f-aa2dcc66c27e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:33.894643 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a35e3fc0-b1b1-4dd6-8c3f-aa2dcc66c27e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:33.895072 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a35e3fc0-b1b1-4dd6-8c3f-aa2dcc66c27e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:33.895519 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a35e3fc0-b1b1-4dd6-8c3f-aa2dcc66c27e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:33.913006 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-a35e3fc0-b1b1-4dd6-8c3f-aa2dcc66c27e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Getting quotas for project 6b2f385a651c408bb9d32b5c4e1ab6ff. Resources: {'instances', 'cores', 'ram'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 23:57:33.916999 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-a35e3fc0-b1b1-4dd6-8c3f-aa2dcc66c27e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Getting quotas for user 296f02c73fc548969bf60df4f8f372b0 and project 6b2f385a651c408bb9d32b5c4e1ab6ff. Resources: {'instances', 'cores', 'ram'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 23:57:33.928864 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a35e3fc0-b1b1-4dd6-8c3f-aa2dcc66c27e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Going to run 1 instances... {{(pid=126976) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 23:57:33.931086 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a35e3fc0-b1b1-4dd6-8c3f-aa2dcc66c27e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='22a47167-5e04-441a-a504-d76d82afc776',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126976) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 23:57:33.983481 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a35e3fc0-b1b1-4dd6-8c3f-aa2dcc66c27e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.641795 Sep 12 23:57:33.984216 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 246/499] 10.222.0.26 () {62 vars in 1188 bytes} [Mon Sep 12 23:57:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 12 23:57:33.997351 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a728d1cf-d98d-45f7-aa0b-c29931f0fb8c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:33.998051 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a728d1cf-d98d-45f7-aa0b-c29931f0fb8c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:34.054942 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a728d1cf-d98d-45f7-aa0b-c29931f0fb8c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:34.063754 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a728d1cf-d98d-45f7-aa0b-c29931f0fb8c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:34.065282 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a728d1cf-d98d-45f7-aa0b-c29931f0fb8c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:34.066451 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a728d1cf-d98d-45f7-aa0b-c29931f0fb8c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1281 microversion: 2.20 time: 0.073121 Sep 12 23:57:34.066977 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 254/500] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:57:33 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1281 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:57:34.198624 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d2fa81fc-17c3-4192-a991-65d59663290e tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:34.199161 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d2fa81fc-17c3-4192-a991-65d59663290e tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 0be21a98-d3f6-4f26-8947-fd39015a7735] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:34.206752 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d2fa81fc-17c3-4192-a991-65d59663290e tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:34.207285 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d2fa81fc-17c3-4192-a991-65d59663290e tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:34.207726 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d2fa81fc-17c3-4192-a991-65d59663290e tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:34.208455 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d2fa81fc-17c3-4192-a991-65d59663290e tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:34.208912 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d2fa81fc-17c3-4192-a991-65d59663290e tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:34.209333 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d2fa81fc-17c3-4192-a991-65d59663290e tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:34.418196 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d2fa81fc-17c3-4192-a991-65d59663290e tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:34.428535 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d2fa81fc-17c3-4192-a991-65d59663290e tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735" status: 200 len: 1729 microversion: 2.1 time: 0.233872 Sep 12 23:57:34.429151 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 247/501] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:34 2022] GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735 => generated 1729 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:57:34.453171 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d28fdcb7-586c-4cf5-ad7e-4be272a80749 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:34.453988 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d28fdcb7-586c-4cf5-ad7e-4be272a80749 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 0be21a98-d3f6-4f26-8947-fd39015a7735] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:34.460628 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d28fdcb7-586c-4cf5-ad7e-4be272a80749 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:34.461127 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d28fdcb7-586c-4cf5-ad7e-4be272a80749 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:34.461594 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d28fdcb7-586c-4cf5-ad7e-4be272a80749 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:34.462512 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d28fdcb7-586c-4cf5-ad7e-4be272a80749 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:34.462969 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d28fdcb7-586c-4cf5-ad7e-4be272a80749 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:34.463437 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d28fdcb7-586c-4cf5-ad7e-4be272a80749 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:34.555299 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d28fdcb7-586c-4cf5-ad7e-4be272a80749 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.106507 Sep 12 23:57:34.555901 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 255/502] 10.222.0.26 () {58 vars in 1275 bytes} [Mon Sep 12 23:57:34 2022] GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735/os-interface => generated 284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:57:35.091901 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-89439688-af89-457b-9684-952c11ff0e1c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:35.092515 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-89439688-af89-457b-9684-952c11ff0e1c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:35.098831 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-89439688-af89-457b-9684-952c11ff0e1c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:35.099360 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-89439688-af89-457b-9684-952c11ff0e1c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:35.099799 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-89439688-af89-457b-9684-952c11ff0e1c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:35.100503 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-89439688-af89-457b-9684-952c11ff0e1c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:35.100977 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-89439688-af89-457b-9684-952c11ff0e1c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:35.101430 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-89439688-af89-457b-9684-952c11ff0e1c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:35.170978 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-89439688-af89-457b-9684-952c11ff0e1c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:35.181472 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-89439688-af89-457b-9684-952c11ff0e1c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:35.182995 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-89439688-af89-457b-9684-952c11ff0e1c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:35.184149 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-89439688-af89-457b-9684-952c11ff0e1c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1333 microversion: 2.20 time: 0.096360 Sep 12 23:57:35.184734 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 248/503] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:57:35 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1333 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:57:35.571838 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-fc379ac9-072b-47e8-adcb-09b26138c04f req-44fa4beb-c878-49d9-9065-d747d8175101 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0be21a98-d3f6-4f26-8947-fd39015a7735", "tag": "36b2ab7e-5dbe-4019-ae5e-f401a7d7cdb1"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:57:35.590260 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-fc379ac9-072b-47e8-adcb-09b26138c04f req-44fa4beb-c878-49d9-9065-d747d8175101 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:35.591732 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-fc379ac9-072b-47e8-adcb-09b26138c04f req-44fa4beb-c878-49d9-9065-d747d8175101 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:35.592280 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-fc379ac9-072b-47e8-adcb-09b26138c04f req-44fa4beb-c878-49d9-9065-d747d8175101 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:35.610376 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-fc379ac9-072b-47e8-adcb-09b26138c04f req-44fa4beb-c878-49d9-9065-d747d8175101 service nova] Creating event network-changed:36b2ab7e-5dbe-4019-ae5e-f401a7d7cdb1 for instance 0be21a98-d3f6-4f26-8947-fd39015a7735 on hv-cinder-82002 Sep 12 23:57:35.615732 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-fc379ac9-072b-47e8-adcb-09b26138c04f req-44fa4beb-c878-49d9-9065-d747d8175101 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057296 Sep 12 23:57:35.616350 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 256/504] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:57:36.211043 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-af6466a1-12d9-460d-85cc-730cf4a1416f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:36.211848 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-af6466a1-12d9-460d-85cc-730cf4a1416f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:36.218901 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-af6466a1-12d9-460d-85cc-730cf4a1416f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:36.219426 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-af6466a1-12d9-460d-85cc-730cf4a1416f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:36.219854 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-af6466a1-12d9-460d-85cc-730cf4a1416f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:36.220805 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-af6466a1-12d9-460d-85cc-730cf4a1416f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:36.221290 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-af6466a1-12d9-460d-85cc-730cf4a1416f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:36.221684 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-af6466a1-12d9-460d-85cc-730cf4a1416f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:36.857581 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-af6466a1-12d9-460d-85cc-730cf4a1416f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:36.867430 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-af6466a1-12d9-460d-85cc-730cf4a1416f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:36.869313 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-af6466a1-12d9-460d-85cc-730cf4a1416f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:36.870660 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-af6466a1-12d9-460d-85cc-730cf4a1416f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1407 microversion: 2.20 time: 0.664466 Sep 12 23:57:36.871382 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 249/505] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:57:36 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1407 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:57:37.568911 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-86bf2fd8-2f11-4d07-93f7-3100763ef64d req-4de65912-90f9-4e7d-877f-7ec8ac740675 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3088bc31-f3ff-476d-a0ad-9f10186b442f", "tag": "8a984b84-cffe-442a-8574-f76c08213db0"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:57:37.579920 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-86bf2fd8-2f11-4d07-93f7-3100763ef64d req-4de65912-90f9-4e7d-877f-7ec8ac740675 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:37.580486 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-86bf2fd8-2f11-4d07-93f7-3100763ef64d req-4de65912-90f9-4e7d-877f-7ec8ac740675 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:37.580969 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-86bf2fd8-2f11-4d07-93f7-3100763ef64d req-4de65912-90f9-4e7d-877f-7ec8ac740675 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:37.602272 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-86bf2fd8-2f11-4d07-93f7-3100763ef64d req-4de65912-90f9-4e7d-877f-7ec8ac740675 service nova] Creating event network-changed:8a984b84-cffe-442a-8574-f76c08213db0 for instance 3088bc31-f3ff-476d-a0ad-9f10186b442f on hv-cinder-82002 Sep 12 23:57:37.608434 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-86bf2fd8-2f11-4d07-93f7-3100763ef64d req-4de65912-90f9-4e7d-877f-7ec8ac740675 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044644 Sep 12 23:57:37.609601 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 257/506] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:57:37.631893 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-328cf12f-13b9-43e5-bd7d-181a30467830 req-68bc4681-aa56-4c0e-a9d1-74909f7d5939 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0be21a98-d3f6-4f26-8947-fd39015a7735", "tag": "36b2ab7e-5dbe-4019-ae5e-f401a7d7cdb1"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:57:37.642064 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-328cf12f-13b9-43e5-bd7d-181a30467830 req-68bc4681-aa56-4c0e-a9d1-74909f7d5939 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:37.642545 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-328cf12f-13b9-43e5-bd7d-181a30467830 req-68bc4681-aa56-4c0e-a9d1-74909f7d5939 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:37.642987 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-328cf12f-13b9-43e5-bd7d-181a30467830 req-68bc4681-aa56-4c0e-a9d1-74909f7d5939 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:37.656841 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-328cf12f-13b9-43e5-bd7d-181a30467830 req-68bc4681-aa56-4c0e-a9d1-74909f7d5939 service nova] Creating event network-changed:36b2ab7e-5dbe-4019-ae5e-f401a7d7cdb1 for instance 0be21a98-d3f6-4f26-8947-fd39015a7735 on hv-cinder-82002 Sep 12 23:57:37.662052 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-328cf12f-13b9-43e5-bd7d-181a30467830 req-68bc4681-aa56-4c0e-a9d1-74909f7d5939 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033792 Sep 12 23:57:37.662663 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 250/507] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:57:37.898031 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5222f52e-dc71-48fc-b54a-a0af1ec75989 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:37.899076 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5222f52e-dc71-48fc-b54a-a0af1ec75989 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:37.905609 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5222f52e-dc71-48fc-b54a-a0af1ec75989 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:37.906214 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5222f52e-dc71-48fc-b54a-a0af1ec75989 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:37.906691 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5222f52e-dc71-48fc-b54a-a0af1ec75989 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:37.908034 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5222f52e-dc71-48fc-b54a-a0af1ec75989 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:37.908451 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5222f52e-dc71-48fc-b54a-a0af1ec75989 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:37.909016 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5222f52e-dc71-48fc-b54a-a0af1ec75989 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:38.232818 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5222f52e-dc71-48fc-b54a-a0af1ec75989 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:38.241630 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5222f52e-dc71-48fc-b54a-a0af1ec75989 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:38.243114 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5222f52e-dc71-48fc-b54a-a0af1ec75989 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:38.244296 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5222f52e-dc71-48fc-b54a-a0af1ec75989 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1407 microversion: 2.20 time: 0.350594 Sep 12 23:57:38.244853 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 258/508] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:57:37 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1407 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:57:39.271524 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9550a8a5-2049-4ef7-9a5a-9437c24d08c3 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:39.272108 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9550a8a5-2049-4ef7-9a5a-9437c24d08c3 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:39.278980 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9550a8a5-2049-4ef7-9a5a-9437c24d08c3 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:39.279490 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9550a8a5-2049-4ef7-9a5a-9437c24d08c3 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:39.279930 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9550a8a5-2049-4ef7-9a5a-9437c24d08c3 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:39.280634 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9550a8a5-2049-4ef7-9a5a-9437c24d08c3 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:39.281067 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9550a8a5-2049-4ef7-9a5a-9437c24d08c3 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:39.281475 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9550a8a5-2049-4ef7-9a5a-9437c24d08c3 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:39.581781 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-9550a8a5-2049-4ef7-9a5a-9437c24d08c3 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:39.591066 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-9550a8a5-2049-4ef7-9a5a-9437c24d08c3 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:39.592725 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-9550a8a5-2049-4ef7-9a5a-9437c24d08c3 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:39.593993 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9550a8a5-2049-4ef7-9a5a-9437c24d08c3 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1407 microversion: 2.20 time: 0.327573 Sep 12 23:57:39.594564 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 251/509] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:57:39 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1407 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:57:40.619376 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-67d35a82-ce10-41a9-9dcb-261f49db5b8b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:40.620038 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-67d35a82-ce10-41a9-9dcb-261f49db5b8b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:40.627023 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-67d35a82-ce10-41a9-9dcb-261f49db5b8b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:40.627525 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-67d35a82-ce10-41a9-9dcb-261f49db5b8b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:40.627981 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-67d35a82-ce10-41a9-9dcb-261f49db5b8b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:40.628686 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-67d35a82-ce10-41a9-9dcb-261f49db5b8b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:40.629125 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-67d35a82-ce10-41a9-9dcb-261f49db5b8b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:40.629540 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-67d35a82-ce10-41a9-9dcb-261f49db5b8b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:40.770062 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-67d35a82-ce10-41a9-9dcb-261f49db5b8b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:40.779518 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-67d35a82-ce10-41a9-9dcb-261f49db5b8b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:40.780959 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-67d35a82-ce10-41a9-9dcb-261f49db5b8b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:40.782083 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-67d35a82-ce10-41a9-9dcb-261f49db5b8b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1407 microversion: 2.20 time: 0.166704 Sep 12 23:57:40.782645 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 259/510] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:57:40 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 23:57:41.810095 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-82b7bd16-ea2d-4a38-92a0-f4df2c74eab0 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:41.811062 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-82b7bd16-ea2d-4a38-92a0-f4df2c74eab0 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:41.818393 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-82b7bd16-ea2d-4a38-92a0-f4df2c74eab0 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:41.818884 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-82b7bd16-ea2d-4a38-92a0-f4df2c74eab0 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:41.819353 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-82b7bd16-ea2d-4a38-92a0-f4df2c74eab0 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:41.820061 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-82b7bd16-ea2d-4a38-92a0-f4df2c74eab0 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:41.820515 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-82b7bd16-ea2d-4a38-92a0-f4df2c74eab0 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:41.820941 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-82b7bd16-ea2d-4a38-92a0-f4df2c74eab0 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:41.966237 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-82b7bd16-ea2d-4a38-92a0-f4df2c74eab0 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:41.981822 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-82b7bd16-ea2d-4a38-92a0-f4df2c74eab0 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:41.984602 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-82b7bd16-ea2d-4a38-92a0-f4df2c74eab0 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:41.986708 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-82b7bd16-ea2d-4a38-92a0-f4df2c74eab0 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1407 microversion: 2.20 time: 0.182768 Sep 12 23:57:41.987762 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 252/511] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:57:41 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:57:43.012864 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5fa74570-69db-466b-91c1-1ed51142b96f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:43.013491 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5fa74570-69db-466b-91c1-1ed51142b96f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:43.016234 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=1 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:57:43.022039 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5fa74570-69db-466b-91c1-1ed51142b96f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:43.022528 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5fa74570-69db-466b-91c1-1ed51142b96f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:43.023351 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5fa74570-69db-466b-91c1-1ed51142b96f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:43.024069 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5fa74570-69db-466b-91c1-1ed51142b96f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:43.024526 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5fa74570-69db-466b-91c1-1ed51142b96f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:43.025225 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5fa74570-69db-466b-91c1-1ed51142b96f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:43.175303 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5fa74570-69db-466b-91c1-1ed51142b96f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:43.184249 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5fa74570-69db-466b-91c1-1ed51142b96f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:43.185706 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5fa74570-69db-466b-91c1-1ed51142b96f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:43.187047 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5fa74570-69db-466b-91c1-1ed51142b96f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1407 microversion: 2.20 time: 0.178093 Sep 12 23:57:43.187733 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 260/512] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:57:43 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:57:43.665548 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-8755d807-fcc7-454f-89f3-b9d83cb43702 req-160c09af-b5f7-4f00-bd31-d7f8244b64e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3088bc31-f3ff-476d-a0ad-9f10186b442f", "name": "network-vif-plugged", "status": "completed", "tag": "8a984b84-cffe-442a-8574-f76c08213db0"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:57:43.677554 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-8755d807-fcc7-454f-89f3-b9d83cb43702 req-160c09af-b5f7-4f00-bd31-d7f8244b64e7 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:43.677939 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-8755d807-fcc7-454f-89f3-b9d83cb43702 req-160c09af-b5f7-4f00-bd31-d7f8244b64e7 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:43.678376 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-8755d807-fcc7-454f-89f3-b9d83cb43702 req-160c09af-b5f7-4f00-bd31-d7f8244b64e7 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:43.692641 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-8755d807-fcc7-454f-89f3-b9d83cb43702 req-160c09af-b5f7-4f00-bd31-d7f8244b64e7 service nova] Creating event network-vif-plugged:8a984b84-cffe-442a-8574-f76c08213db0 for instance 3088bc31-f3ff-476d-a0ad-9f10186b442f on hv-cinder-82002 Sep 12 23:57:43.698461 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-8755d807-fcc7-454f-89f3-b9d83cb43702 req-160c09af-b5f7-4f00-bd31-d7f8244b64e7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037430 Sep 12 23:57:43.699279 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 253/513] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:57:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:57:44.212892 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-df41e188-be73-4366-a7fa-00b683f825d2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:44.213697 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-df41e188-be73-4366-a7fa-00b683f825d2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:44.216177 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell0:SELECT=6 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:57:44.221968 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-df41e188-be73-4366-a7fa-00b683f825d2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:44.222458 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-df41e188-be73-4366-a7fa-00b683f825d2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:44.222890 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-df41e188-be73-4366-a7fa-00b683f825d2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:44.223653 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-df41e188-be73-4366-a7fa-00b683f825d2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:44.224123 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-df41e188-be73-4366-a7fa-00b683f825d2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:44.224539 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-df41e188-be73-4366-a7fa-00b683f825d2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:44.369670 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-df41e188-be73-4366-a7fa-00b683f825d2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:44.378949 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-df41e188-be73-4366-a7fa-00b683f825d2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:44.380426 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-df41e188-be73-4366-a7fa-00b683f825d2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:44.381600 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-df41e188-be73-4366-a7fa-00b683f825d2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1407 microversion: 2.20 time: 0.172745 Sep 12 23:57:44.382166 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 261/514] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:57:44 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:57:45.406616 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell0:SELECT=2 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:57:45.407474 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell0:SELECT=6 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:57:45.413362 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7ae4d17f-e4b1-4712-b392-76f74070c3fe tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:45.414086 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7ae4d17f-e4b1-4712-b392-76f74070c3fe tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:45.421577 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7ae4d17f-e4b1-4712-b392-76f74070c3fe tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:45.422065 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7ae4d17f-e4b1-4712-b392-76f74070c3fe tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:45.422491 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7ae4d17f-e4b1-4712-b392-76f74070c3fe tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:45.423195 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7ae4d17f-e4b1-4712-b392-76f74070c3fe tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:45.423665 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7ae4d17f-e4b1-4712-b392-76f74070c3fe tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:45.424088 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7ae4d17f-e4b1-4712-b392-76f74070c3fe tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:45.566093 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7ae4d17f-e4b1-4712-b392-76f74070c3fe tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:45.576621 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7ae4d17f-e4b1-4712-b392-76f74070c3fe tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:45.578143 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7ae4d17f-e4b1-4712-b392-76f74070c3fe tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:45.579361 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7ae4d17f-e4b1-4712-b392-76f74070c3fe tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1407 microversion: 2.20 time: 0.173773 Sep 12 23:57:45.580558 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 254/515] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:57:45 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:57:46.608633 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a88818d7-46cc-480e-b1f2-79205ef891c5 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:46.609260 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a88818d7-46cc-480e-b1f2-79205ef891c5 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:46.616551 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a88818d7-46cc-480e-b1f2-79205ef891c5 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:46.617191 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a88818d7-46cc-480e-b1f2-79205ef891c5 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:46.617748 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a88818d7-46cc-480e-b1f2-79205ef891c5 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:46.618485 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a88818d7-46cc-480e-b1f2-79205ef891c5 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:46.618934 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a88818d7-46cc-480e-b1f2-79205ef891c5 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:46.619376 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a88818d7-46cc-480e-b1f2-79205ef891c5 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:46.763050 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a88818d7-46cc-480e-b1f2-79205ef891c5 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:46.772291 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a88818d7-46cc-480e-b1f2-79205ef891c5 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:46.774091 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a88818d7-46cc-480e-b1f2-79205ef891c5 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:46.775256 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a88818d7-46cc-480e-b1f2-79205ef891c5 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1598 microversion: 2.20 time: 0.171275 Sep 12 23:57:46.775832 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 262/516] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:57:46 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1598 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:57:46.800917 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-41a6f184-c7e8-4b97-987a-1168f1c4457e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:46.801495 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-41a6f184-c7e8-4b97-987a-1168f1c4457e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:46.808295 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-41a6f184-c7e8-4b97-987a-1168f1c4457e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:46.808779 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-41a6f184-c7e8-4b97-987a-1168f1c4457e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:46.809216 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-41a6f184-c7e8-4b97-987a-1168f1c4457e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:46.809944 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-41a6f184-c7e8-4b97-987a-1168f1c4457e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:46.810386 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-41a6f184-c7e8-4b97-987a-1168f1c4457e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:46.810835 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-41a6f184-c7e8-4b97-987a-1168f1c4457e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:46.889264 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-41a6f184-c7e8-4b97-987a-1168f1c4457e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.092638 Sep 12 23:57:46.890180 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 255/517] 10.222.0.26 () {60 vars in 1316 bytes} [Mon Sep 12 23:57:46 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 23:57:47.689315 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7779343b-f61b-4a89-b985-ba85f89cb878 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-322726012"}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:57:47.689874 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7779343b-f61b-4a89-b985-ba85f89cb878 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] [instance: c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:47.696273 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7779343b-f61b-4a89-b985-ba85f89cb878 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:47.696755 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7779343b-f61b-4a89-b985-ba85f89cb878 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:47.697192 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7779343b-f61b-4a89-b985-ba85f89cb878 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:47.697922 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7779343b-f61b-4a89-b985-ba85f89cb878 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:47.698336 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7779343b-f61b-4a89-b985-ba85f89cb878 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:47.698752 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7779343b-f61b-4a89-b985-ba85f89cb878 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:47.845094 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.network.security_group_api [None req-7779343b-f61b-4a89-b985-ba85f89cb878 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Removing security group 13203dc5-2165-400b-9f8d-a87a9b53aa17 from port 57c9f24f-46a8-416f-96ec-1d08fd0338ff Sep 12 23:57:47.936352 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-ffdf2c2d-7825-40d8-82ee-1110b5556c14 req-5448ae72-953a-48d3-8579-e56cc0b62a34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3088bc31-f3ff-476d-a0ad-9f10186b442f", "tag": "8a984b84-cffe-442a-8574-f76c08213db0"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:57:47.946856 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-ffdf2c2d-7825-40d8-82ee-1110b5556c14 req-5448ae72-953a-48d3-8579-e56cc0b62a34 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:47.946856 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-ffdf2c2d-7825-40d8-82ee-1110b5556c14 req-5448ae72-953a-48d3-8579-e56cc0b62a34 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:47.947097 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-ffdf2c2d-7825-40d8-82ee-1110b5556c14 req-5448ae72-953a-48d3-8579-e56cc0b62a34 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:47.960172 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-ffdf2c2d-7825-40d8-82ee-1110b5556c14 req-5448ae72-953a-48d3-8579-e56cc0b62a34 service nova] Creating event network-changed:8a984b84-cffe-442a-8574-f76c08213db0 for instance 3088bc31-f3ff-476d-a0ad-9f10186b442f on hv-cinder-82002 Sep 12 23:57:47.965604 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-ffdf2c2d-7825-40d8-82ee-1110b5556c14 req-5448ae72-953a-48d3-8579-e56cc0b62a34 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033421 Sep 12 23:57:47.966216 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 256/518] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 23:57:48.334074 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7779343b-f61b-4a89-b985-ba85f89cb878 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "POST /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a/action" status: 202 len: 0 microversion: 2.1 time: 0.648450 Sep 12 23:57:48.335421 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 263/519] 10.222.0.26 () {60 vars in 1278 bytes} [Mon Sep 12 23:57:47 2022] POST /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a/action => generated 0 bytes in 651 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 23:57:48.343977 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-e2f2ab1f-1413-4f2c-9711-14dc90476e88 req-7467177e-0987-4415-b0d0-8cee4be8f3cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a", "tag": "57c9f24f-46a8-416f-96ec-1d08fd0338ff"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:57:48.354116 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-e2f2ab1f-1413-4f2c-9711-14dc90476e88 req-7467177e-0987-4415-b0d0-8cee4be8f3cc service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:48.354970 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-e2f2ab1f-1413-4f2c-9711-14dc90476e88 req-7467177e-0987-4415-b0d0-8cee4be8f3cc service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:48.355659 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-e2f2ab1f-1413-4f2c-9711-14dc90476e88 req-7467177e-0987-4415-b0d0-8cee4be8f3cc service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:48.378865 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-e2f2ab1f-1413-4f2c-9711-14dc90476e88 req-7467177e-0987-4415-b0d0-8cee4be8f3cc service nova] Creating event network-changed:57c9f24f-46a8-416f-96ec-1d08fd0338ff for instance c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a on hv-cinder-82002 Sep 12 23:57:48.397515 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-e2f2ab1f-1413-4f2c-9711-14dc90476e88 req-7467177e-0987-4415-b0d0-8cee4be8f3cc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057389 Sep 12 23:57:48.399268 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 257/520] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:57:49.675694 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c8d7a55d-6b4f-4317-9cf2-5a1b3542c942 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:49.676288 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c8d7a55d-6b4f-4317-9cf2-5a1b3542c942 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] [instance: c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:49.682348 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c8d7a55d-6b4f-4317-9cf2-5a1b3542c942 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:49.682820 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c8d7a55d-6b4f-4317-9cf2-5a1b3542c942 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:49.683248 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c8d7a55d-6b4f-4317-9cf2-5a1b3542c942 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:49.683962 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c8d7a55d-6b4f-4317-9cf2-5a1b3542c942 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:49.684398 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c8d7a55d-6b4f-4317-9cf2-5a1b3542c942 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:49.684818 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c8d7a55d-6b4f-4317-9cf2-5a1b3542c942 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:49.813636 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.objects.instance [None req-c8d7a55d-6b4f-4317-9cf2-5a1b3542c942 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lazy-loading 'services' on Instance uuid c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a {{(pid=126975) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 23:57:49.935083 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c8d7a55d-6b4f-4317-9cf2-5a1b3542c942 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a/os-volume_attachments/7f59ceb4-d314-4dea-80d7-b100fdc1baf8" status: 202 len: 0 microversion: 2.1 time: 0.264043 Sep 12 23:57:49.935736 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 264/521] 10.222.0.26 () {58 vars in 1416 bytes} [Mon Sep 12 23:57:49 2022] DELETE /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a/os-volume_attachments/7f59ceb4-d314-4dea-80d7-b100fdc1baf8 => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 23:57:49.945922 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-eb9247b2-671d-48e8-985a-dc7c5e569ae1 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:49.948491 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-eb9247b2-671d-48e8-985a-dc7c5e569ae1 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] [instance: c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:49.955028 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eb9247b2-671d-48e8-985a-dc7c5e569ae1 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:49.955700 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eb9247b2-671d-48e8-985a-dc7c5e569ae1 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:49.956363 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eb9247b2-671d-48e8-985a-dc7c5e569ae1 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:49.957281 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eb9247b2-671d-48e8-985a-dc7c5e569ae1 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:49.958156 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eb9247b2-671d-48e8-985a-dc7c5e569ae1 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:49.958431 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-eb9247b2-671d-48e8-985a-dc7c5e569ae1 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:49.974268 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:57:49.987014 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-aa414131-a3f9-4bc7-a0e6-e33899764277 req-14a79e93-2e4e-41c9-a069-6a18d85a5a68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a", "tag": "57c9f24f-46a8-416f-96ec-1d08fd0338ff"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:57:49.992756 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-eb9247b2-671d-48e8-985a-dc7c5e569ae1 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051854 Sep 12 23:57:49.993342 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 258/522] 10.222.0.26 () {58 vars in 1302 bytes} [Mon Sep 12 23:57:49 2022] GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:57:50.002726 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-aa414131-a3f9-4bc7-a0e6-e33899764277 req-14a79e93-2e4e-41c9-a069-6a18d85a5a68 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:50.003853 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-aa414131-a3f9-4bc7-a0e6-e33899764277 req-14a79e93-2e4e-41c9-a069-6a18d85a5a68 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:50.004279 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-aa414131-a3f9-4bc7-a0e6-e33899764277 req-14a79e93-2e4e-41c9-a069-6a18d85a5a68 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:50.017090 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-aa414131-a3f9-4bc7-a0e6-e33899764277 req-14a79e93-2e4e-41c9-a069-6a18d85a5a68 service nova] Creating event network-changed:57c9f24f-46a8-416f-96ec-1d08fd0338ff for instance c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a on hv-cinder-82002 Sep 12 23:57:50.023105 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-aa414131-a3f9-4bc7-a0e6-e33899764277 req-14a79e93-2e4e-41c9-a069-6a18d85a5a68 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040431 Sep 12 23:57:50.023755 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 265/523] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:57:51.005989 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5533ffdb-a483-4b27-be59-67a17aa034c4 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:51.008754 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5533ffdb-a483-4b27-be59-67a17aa034c4 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] [instance: c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:51.015697 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5533ffdb-a483-4b27-be59-67a17aa034c4 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:51.018611 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5533ffdb-a483-4b27-be59-67a17aa034c4 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:51.018611 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5533ffdb-a483-4b27-be59-67a17aa034c4 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:51.018611 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5533ffdb-a483-4b27-be59-67a17aa034c4 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:51.018611 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5533ffdb-a483-4b27-be59-67a17aa034c4 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:51.018962 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5533ffdb-a483-4b27-be59-67a17aa034c4 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:51.050169 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5533ffdb-a483-4b27-be59-67a17aa034c4 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048188 Sep 12 23:57:51.050744 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 259/524] 10.222.0.26 () {58 vars in 1302 bytes} [Mon Sep 12 23:57:51 2022] GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 12 23:57:51.062758 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2c74a50a-fbdf-4a06-ab26-0c044a462540 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:51.063354 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2c74a50a-fbdf-4a06-ab26-0c044a462540 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] [instance: c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:51.069865 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2c74a50a-fbdf-4a06-ab26-0c044a462540 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:51.070471 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2c74a50a-fbdf-4a06-ab26-0c044a462540 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:51.070777 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2c74a50a-fbdf-4a06-ab26-0c044a462540 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:51.071606 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2c74a50a-fbdf-4a06-ab26-0c044a462540 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:51.072065 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2c74a50a-fbdf-4a06-ab26-0c044a462540 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:51.072493 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2c74a50a-fbdf-4a06-ab26-0c044a462540 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:51.145691 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:57:51.152170 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-2c74a50a-fbdf-4a06-ab26-0c044a462540 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] HTTP exception thrown: Instance c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a is not attached to volume 7f59ceb4-d314-4dea-80d7-b100fdc1baf8 Sep 12 23:57:51.154813 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2c74a50a-fbdf-4a06-ab26-0c044a462540 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Request method failure captured: Sep 12 23:57:51.154813 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: request: DELETE /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a/os-volume_attachments/7f59ceb4-d314-4dea-80d7-b100fdc1baf8 HTTP/1.1 Sep 12 23:57:51.154813 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept: application/json Sep 12 23:57:51.154813 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Sep 12 23:57:51.154813 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Connection: close Sep 12 23:57:51.154813 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Length: 0 Sep 12 23:57:51.154813 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Type: application/json Sep 12 23:57:51.154813 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Host: 10.222.0.26 Sep 12 23:57:51.154813 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Sep 12 23:57:51.154813 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Sep 12 23:57:51.154813 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjH8a7slHSP-uJQY8Qon1TFQIrD5jlLTkNP2vDpWKkWg7AQt_gRZ6gqyYWbLQahfKOj5vEZ1bOAEoIc97wpbyK9BN7h4cl0aGmp1ZIWXLqRjeE7gJwxc0KdNd6yAAZAO5vOmRIOj7hSCXk2B_8lUlbqsphmMtNAXalOTwayFDs7rX-GnE Sep 12 23:57:51.154813 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Sep 12 23:57:51.154813 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Sep 12 23:57:51.154813 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Sep 12 23:57:51.154813 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Sep 12 23:57:51.154813 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Sep 12 23:57:51.154813 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Sep 12 23:57:51.154813 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Id: 880f7d1c88224ebd85d15f7c43e7fe72 Sep 12 23:57:51.154813 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-TestMinimumBasicScenario-1265219423 Sep 12 23:57:51.154813 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Role: member,reader Sep 12 23:57:51.154813 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Roles: member,reader Sep 12 23:57:51.156316 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/880f7d1c88224ebd85d15f7c43e7fe72"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/880f7d1c88224ebd85d15f7c43e7fe72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_880f7d1c88224ebd85d15f7c43e7fe72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/880f7d1c88224ebd85d15f7c43e7fe72"}]}] Sep 12 23:57:51.156316 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-TestMinimumBasicScenario-1265219423 Sep 12 23:57:51.156316 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Id: 880f7d1c88224ebd85d15f7c43e7fe72 Sep 12 23:57:51.156316 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1265219423 Sep 12 23:57:51.156316 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User: tempest-TestMinimumBasicScenario-1265219423-project Sep 12 23:57:51.156316 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Sep 12 23:57:51.156316 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Sep 12 23:57:51.156316 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Id: e76b3353ce4b4361872ed6dba9f895d6 Sep 12 23:57:51.156316 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-TestMinimumBasicScenario-1265219423-project Sep 12 23:57:51.156316 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: method: > Sep 12 23:57:51.156316 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: exception: Instance c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a is not attached to volume 7f59ceb4-d314-4dea-80d7-b100fdc1baf8 Sep 12 23:57:51.157116 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: action_args: {'server_id': 'c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a', 'id': '7f59ceb4-d314-4dea-80d7-b100fdc1baf8'} Sep 12 23:57:51.157116 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:57:51.157116 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:57:51.157116 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 12 23:57:51.157116 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 12 23:57:51.157116 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 12 23:57:51.157116 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 12 23:57:51.157116 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 12 23:57:51.157116 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 12 23:57:51.157116 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 7f59ceb4-d314-4dea-80d7-b100fdc1baf8. Sep 12 23:57:51.157116 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:57:51.157116 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:57:51.157116 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:57:51.157116 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:57:51.157116 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:57:51.157116 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:57:51.157116 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:57:51.157116 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:57:51.157116 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:57:51.158216 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:57:51.158216 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 12 23:57:51.158216 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 12 23:57:51.158216 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a is not attached to volume 7f59ceb4-d314-4dea-80d7-b100fdc1baf8 Sep 12 23:57:51.158216 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:57:51.158216 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:57:51.158216 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:57:51.158216 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:57:51.158216 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:57:51.158216 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:57:51.158216 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:57:51.158216 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:57:51.158216 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a is not attached to volume 7f59ceb4-d314-4dea-80d7-b100fdc1baf8 Sep 12 23:57:51.158216 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:57:51.158216 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2c74a50a-fbdf-4a06-ab26-0c044a462540 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Returning 404 to user: Instance c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a is not attached to volume 7f59ceb4-d314-4dea-80d7-b100fdc1baf8 {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:57:51.159208 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2c74a50a-fbdf-4a06-ab26-0c044a462540 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a/os-volume_attachments/7f59ceb4-d314-4dea-80d7-b100fdc1baf8" status: 404 len: 154 microversion: 2.1 time: 0.098743 Sep 12 23:57:51.159208 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 266/525] 10.222.0.26 () {58 vars in 1416 bytes} [Mon Sep 12 23:57:51 2022] DELETE /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a/os-volume_attachments/7f59ceb4-d314-4dea-80d7-b100fdc1baf8 => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:57:52.304221 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d37ffbd4-305e-4649-9af7-d44c2822470f tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:52.304782 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d37ffbd4-305e-4649-9af7-d44c2822470f tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] [instance: c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:52.311613 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d37ffbd4-305e-4649-9af7-d44c2822470f tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:52.312115 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d37ffbd4-305e-4649-9af7-d44c2822470f tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:52.312538 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d37ffbd4-305e-4649-9af7-d44c2822470f tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:52.313225 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d37ffbd4-305e-4649-9af7-d44c2822470f tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:52.313666 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d37ffbd4-305e-4649-9af7-d44c2822470f tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:52.314076 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d37ffbd4-305e-4649-9af7-d44c2822470f tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:52.344402 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d37ffbd4-305e-4649-9af7-d44c2822470f tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] [instance: c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a] Going to try to terminate instance {{(pid=126976) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 23:57:52.436185 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d37ffbd4-305e-4649-9af7-d44c2822470f tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a" status: 204 len: 0 microversion: 2.1 time: 0.135340 Sep 12 23:57:52.437262 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 260/526] 10.222.0.26 () {58 vars in 1239 bytes} [Mon Sep 12 23:57:52 2022] DELETE /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 12 23:57:52.449101 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-04f673b0-f769-4daf-99c3-ceffcf4887ee tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:52.449766 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-04f673b0-f769-4daf-99c3-ceffcf4887ee tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] [instance: c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:52.460070 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-04f673b0-f769-4daf-99c3-ceffcf4887ee tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:52.460755 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-04f673b0-f769-4daf-99c3-ceffcf4887ee tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:52.461202 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-04f673b0-f769-4daf-99c3-ceffcf4887ee tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:52.462120 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-04f673b0-f769-4daf-99c3-ceffcf4887ee tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:52.462838 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-04f673b0-f769-4daf-99c3-ceffcf4887ee tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:52.463541 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-04f673b0-f769-4daf-99c3-ceffcf4887ee tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:52.607018 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-04f673b0-f769-4daf-99c3-ceffcf4887ee tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76b3353ce4b4361872ed6dba9f895d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f7d1c88224ebd85d15f7c43e7fe72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:52.616412 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-04f673b0-f769-4daf-99c3-ceffcf4887ee tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a" status: 200 len: 1556 microversion: 2.1 time: 0.174574 Sep 12 23:57:52.617049 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 267/527] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:52 2022] GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a => generated 1556 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:57:53.644640 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1cf16aa6-de56-496f-b50b-e1900a294bef tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:53.646269 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1cf16aa6-de56-496f-b50b-e1900a294bef tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] [instance: c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:53.649211 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:57:53.654806 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1cf16aa6-de56-496f-b50b-e1900a294bef tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:53.655394 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1cf16aa6-de56-496f-b50b-e1900a294bef tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:53.655832 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1cf16aa6-de56-496f-b50b-e1900a294bef tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:53.656538 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1cf16aa6-de56-496f-b50b-e1900a294bef tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:53.656987 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1cf16aa6-de56-496f-b50b-e1900a294bef tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:53.657411 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1cf16aa6-de56-496f-b50b-e1900a294bef tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:53.807334 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-1cf16aa6-de56-496f-b50b-e1900a294bef tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76b3353ce4b4361872ed6dba9f895d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f7d1c88224ebd85d15f7c43e7fe72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:53.816008 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1cf16aa6-de56-496f-b50b-e1900a294bef tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a" status: 200 len: 1556 microversion: 2.1 time: 0.176796 Sep 12 23:57:53.816572 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 261/528] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:53 2022] GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a => generated 1556 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:57:54.842674 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8e71e93f-cd8d-4ac5-b882-e54215d33358 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:54.843685 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8e71e93f-cd8d-4ac5-b882-e54215d33358 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] [instance: c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:54.854078 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e71e93f-cd8d-4ac5-b882-e54215d33358 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:54.854572 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e71e93f-cd8d-4ac5-b882-e54215d33358 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:54.855036 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e71e93f-cd8d-4ac5-b882-e54215d33358 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:54.855802 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e71e93f-cd8d-4ac5-b882-e54215d33358 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:54.856247 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e71e93f-cd8d-4ac5-b882-e54215d33358 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:54.856662 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e71e93f-cd8d-4ac5-b882-e54215d33358 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:55.096219 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8e71e93f-cd8d-4ac5-b882-e54215d33358 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e76b3353ce4b4361872ed6dba9f895d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '880f7d1c88224ebd85d15f7c43e7fe72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:55.105543 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8e71e93f-cd8d-4ac5-b882-e54215d33358 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a" status: 200 len: 1556 microversion: 2.1 time: 0.269561 Sep 12 23:57:55.106166 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 268/529] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:54 2022] GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a => generated 1556 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:57:55.332364 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-e7190aa4-c8a5-4042-b9bf-c61357b4eb8c req-9cd7e9fc-ac08-4d91-98bb-0ab3d741522b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a", "name": "network-vif-deleted", "tag": "57c9f24f-46a8-416f-96ec-1d08fd0338ff"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:57:55.343014 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-e7190aa4-c8a5-4042-b9bf-c61357b4eb8c req-9cd7e9fc-ac08-4d91-98bb-0ab3d741522b service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:55.343528 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-e7190aa4-c8a5-4042-b9bf-c61357b4eb8c req-9cd7e9fc-ac08-4d91-98bb-0ab3d741522b service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:55.343950 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-e7190aa4-c8a5-4042-b9bf-c61357b4eb8c req-9cd7e9fc-ac08-4d91-98bb-0ab3d741522b service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:55.356261 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-e7190aa4-c8a5-4042-b9bf-c61357b4eb8c req-9cd7e9fc-ac08-4d91-98bb-0ab3d741522b service nova] Creating event network-vif-deleted:57c9f24f-46a8-416f-96ec-1d08fd0338ff for instance c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a on hv-cinder-82002 Sep 12 23:57:55.361491 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-e7190aa4-c8a5-4042-b9bf-c61357b4eb8c req-9cd7e9fc-ac08-4d91-98bb-0ab3d741522b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032786 Sep 12 23:57:55.362392 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 262/530] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:57:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:57:56.129216 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-6b6fcf82-5392-43f6-a9f5-b2c62cbff199 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:56.130585 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-6b6fcf82-5392-43f6-a9f5-b2c62cbff199 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] [instance: c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:56.137575 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6b6fcf82-5392-43f6-a9f5-b2c62cbff199 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:56.138055 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6b6fcf82-5392-43f6-a9f5-b2c62cbff199 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:56.138507 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6b6fcf82-5392-43f6-a9f5-b2c62cbff199 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:56.139449 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6b6fcf82-5392-43f6-a9f5-b2c62cbff199 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:56.139762 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6b6fcf82-5392-43f6-a9f5-b2c62cbff199 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:56.140172 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6b6fcf82-5392-43f6-a9f5-b2c62cbff199 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:56.155798 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-6b6fcf82-5392-43f6-a9f5-b2c62cbff199 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] HTTP exception thrown: Instance c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a could not be found. Sep 12 23:57:56.157360 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-6b6fcf82-5392-43f6-a9f5-b2c62cbff199 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Request method failure captured: Sep 12 23:57:56.157360 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: request: GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a HTTP/1.1 Sep 12 23:57:56.157360 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept: application/json Sep 12 23:57:56.157360 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Sep 12 23:57:56.157360 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Connection: close Sep 12 23:57:56.157360 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Length: 0 Sep 12 23:57:56.157360 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Type: application/json Sep 12 23:57:56.157360 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Host: 10.222.0.26 Sep 12 23:57:56.157360 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Sep 12 23:57:56.157360 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Sep 12 23:57:56.157360 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjH8a7slHSP-uJQY8Qon1TFQIrD5jlLTkNP2vDpWKkWg7AQt_gRZ6gqyYWbLQahfKOj5vEZ1bOAEoIc97wpbyK9BN7h4cl0aGmp1ZIWXLqRjeE7gJwxc0KdNd6yAAZAO5vOmRIOj7hSCXk2B_8lUlbqsphmMtNAXalOTwayFDs7rX-GnE Sep 12 23:57:56.157360 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Sep 12 23:57:56.157360 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Sep 12 23:57:56.157360 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Sep 12 23:57:56.157360 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Sep 12 23:57:56.157360 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Sep 12 23:57:56.157360 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Sep 12 23:57:56.157360 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Id: 880f7d1c88224ebd85d15f7c43e7fe72 Sep 12 23:57:56.157360 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-TestMinimumBasicScenario-1265219423 Sep 12 23:57:56.157360 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Role: member,reader Sep 12 23:57:56.157360 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Roles: member,reader Sep 12 23:57:56.158700 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/880f7d1c88224ebd85d15f7c43e7fe72"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/880f7d1c88224ebd85d15f7c43e7fe72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_880f7d1c88224ebd85d15f7c43e7fe72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/880f7d1c88224ebd85d15f7c43e7fe72"}]}] Sep 12 23:57:56.158700 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-TestMinimumBasicScenario-1265219423 Sep 12 23:57:56.158700 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Id: 880f7d1c88224ebd85d15f7c43e7fe72 Sep 12 23:57:56.158700 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1265219423 Sep 12 23:57:56.158700 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User: tempest-TestMinimumBasicScenario-1265219423-project Sep 12 23:57:56.158700 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Sep 12 23:57:56.158700 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Sep 12 23:57:56.158700 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Id: e76b3353ce4b4361872ed6dba9f895d6 Sep 12 23:57:56.158700 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-TestMinimumBasicScenario-1265219423-project Sep 12 23:57:56.158700 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: method: > Sep 12 23:57:56.158700 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: exception: Instance c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a could not be found. Sep 12 23:57:56.158700 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: action_args: {'id': 'c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a'} Sep 12 23:57:56.159583 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:57:56.159583 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:57:56.159583 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:57:56.159583 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:57:56.159583 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:57:56.159583 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:57:56.159583 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:57:56.159583 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:57:56.159583 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:57:56.159583 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:57:56.159583 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a could not be found. Sep 12 23:57:56.159583 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:57:56.159583 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:57:56.159583 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:57:56.159583 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:57:56.159583 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:57:56.159583 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:57:56.159583 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:57:56.159583 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:57:56.159583 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:57:56.160737 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:57:56.160737 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 23:57:56.160737 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 23:57:56.160737 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:57:56.160737 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:57:56.160737 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:57:56.160737 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:57:56.160737 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a could not be found. Sep 12 23:57:56.160737 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:57:56.160737 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:57:56.160737 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:57:56.160737 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:57:56.160737 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:57:56.160737 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:57:56.160737 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:57:56.160737 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:57:56.160737 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a could not be found. Sep 12 23:57:56.160737 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:57:56.161737 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-6b6fcf82-5392-43f6-a9f5-b2c62cbff199 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Returning 404 to user: Instance c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a could not be found. {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:57:56.161737 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-6b6fcf82-5392-43f6-a9f5-b2c62cbff199 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a" status: 404 len: 111 microversion: 2.1 time: 0.033644 Sep 12 23:57:56.161737 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 269/531] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:56 2022] GET /compute/v2.1/servers/c9e5a2d1-b35b-4e80-bc10-5c394ceb3a9a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:57:56.168905 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6a9b6345-42a4-40e3-bb68-b52fcf791c67 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] Calling method '.version_select at 0x7fed0148d790>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:56.193436 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6a9b6345-42a4-40e3-bb68-b52fcf791c67 tempest-TestMinimumBasicScenario-1265219423 tempest-TestMinimumBasicScenario-1265219423-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1956934466" status: 202 len: 0 microversion: 2.1 time: 0.029011 Sep 12 23:57:56.194088 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 263/532] 10.222.0.26 () {58 vars in 1272 bytes} [Mon Sep 12 23:57:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1956934466 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 12 23:57:57.321091 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-20892217-673b-4606-8488-32728d0dffb8 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:57.321694 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-20892217-673b-4606-8488-32728d0dffb8 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:57.328782 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-20892217-673b-4606-8488-32728d0dffb8 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:57.329401 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-20892217-673b-4606-8488-32728d0dffb8 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:57.329914 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-20892217-673b-4606-8488-32728d0dffb8 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:57.330631 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-20892217-673b-4606-8488-32728d0dffb8 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:57.331090 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-20892217-673b-4606-8488-32728d0dffb8 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:57.331515 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-20892217-673b-4606-8488-32728d0dffb8 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:57.426422 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.objects.instance [None req-20892217-673b-4606-8488-32728d0dffb8 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lazy-loading 'services' on Instance uuid df2886ea-3e42-4713-82e6-bacd4de26d8c {{(pid=126975) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 23:57:57.511811 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-20892217-673b-4606-8488-32728d0dffb8 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "DELETE /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c/os-volume_attachments/23ee1ab9-4540-40bf-8815-9f773ac28599" status: 202 len: 0 microversion: 2.1 time: 0.194669 Sep 12 23:57:57.512427 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 270/533] 10.222.0.26 () {58 vars in 1416 bytes} [Mon Sep 12 23:57:57 2022] DELETE /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c/os-volume_attachments/23ee1ab9-4540-40bf-8815-9f773ac28599 => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 23:57:58.661556 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-72e7ae61-c63d-4622-a288-84609f68bf1b tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:57:58.669041 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-72e7ae61-c63d-4622-a288-84609f68bf1b tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:58.669809 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-72e7ae61-c63d-4622-a288-84609f68bf1b tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:58.670414 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-72e7ae61-c63d-4622-a288-84609f68bf1b tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:58.697026 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-72e7ae61-c63d-4622-a288-84609f68bf1b tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Going to try to stop instance {{(pid=126976) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 12 23:57:58.753294 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-72e7ae61-c63d-4622-a288-84609f68bf1b tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "POST /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c/action" status: 202 len: 0 microversion: 2.1 time: 0.095295 Sep 12 23:57:58.754020 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 264/534] 10.222.0.26 () {60 vars in 1278 bytes} [Mon Sep 12 23:57:58 2022] POST /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 12 23:57:58.763721 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a1674cec-eb94-43dc-aef0-a71eab47822a tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:57:58.765279 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a1674cec-eb94-43dc-aef0-a71eab47822a tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:57:58.781463 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a1674cec-eb94-43dc-aef0-a71eab47822a tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:58.782080 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a1674cec-eb94-43dc-aef0-a71eab47822a tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:58.782587 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a1674cec-eb94-43dc-aef0-a71eab47822a tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:58.786005 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a1674cec-eb94-43dc-aef0-a71eab47822a tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:57:58.786585 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a1674cec-eb94-43dc-aef0-a71eab47822a tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:57:58.787085 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a1674cec-eb94-43dc-aef0-a71eab47822a tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:57:59.046966 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a1674cec-eb94-43dc-aef0-a71eab47822a tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:57:59.062386 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a1674cec-eb94-43dc-aef0-a71eab47822a tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c" status: 200 len: 1676 microversion: 2.1 time: 0.303448 Sep 12 23:57:59.062984 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 271/535] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:57:58 2022] GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c => generated 1676 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:58:00.095716 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-085e05f9-d2f2-478e-99b7-8e012eb944f4 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:00.096300 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-085e05f9-d2f2-478e-99b7-8e012eb944f4 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:00.110125 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-085e05f9-d2f2-478e-99b7-8e012eb944f4 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:00.111248 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-085e05f9-d2f2-478e-99b7-8e012eb944f4 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:00.112106 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-085e05f9-d2f2-478e-99b7-8e012eb944f4 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:00.113210 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-085e05f9-d2f2-478e-99b7-8e012eb944f4 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:00.113902 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-085e05f9-d2f2-478e-99b7-8e012eb944f4 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:00.114578 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-085e05f9-d2f2-478e-99b7-8e012eb944f4 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:00.407936 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-085e05f9-d2f2-478e-99b7-8e012eb944f4 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:00.416721 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-085e05f9-d2f2-478e-99b7-8e012eb944f4 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c" status: 200 len: 1676 microversion: 2.1 time: 0.330865 Sep 12 23:58:00.417329 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 265/536] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:58:00 2022] GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c => generated 1676 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:58:01.440554 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-11a19e6d-82e3-40a2-b07c-7789bc28007f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:01.441384 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-11a19e6d-82e3-40a2-b07c-7789bc28007f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:01.449017 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-11a19e6d-82e3-40a2-b07c-7789bc28007f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:01.449517 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-11a19e6d-82e3-40a2-b07c-7789bc28007f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:01.449953 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-11a19e6d-82e3-40a2-b07c-7789bc28007f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:01.450685 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-11a19e6d-82e3-40a2-b07c-7789bc28007f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:01.451141 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-11a19e6d-82e3-40a2-b07c-7789bc28007f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:01.451662 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-11a19e6d-82e3-40a2-b07c-7789bc28007f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:01.611182 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-11a19e6d-82e3-40a2-b07c-7789bc28007f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:01.620365 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-11a19e6d-82e3-40a2-b07c-7789bc28007f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c" status: 200 len: 1676 microversion: 2.1 time: 0.183869 Sep 12 23:58:01.621194 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 272/537] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:58:01 2022] GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c => generated 1676 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:58:02.664022 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0d94b7f6-4e01-4cdd-a0f1-39ef587ff97e tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:02.665556 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0d94b7f6-4e01-4cdd-a0f1-39ef587ff97e tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:02.678076 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d94b7f6-4e01-4cdd-a0f1-39ef587ff97e tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:02.679138 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d94b7f6-4e01-4cdd-a0f1-39ef587ff97e tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:02.680129 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d94b7f6-4e01-4cdd-a0f1-39ef587ff97e tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:02.681579 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d94b7f6-4e01-4cdd-a0f1-39ef587ff97e tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:02.682522 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d94b7f6-4e01-4cdd-a0f1-39ef587ff97e tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:02.683568 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0d94b7f6-4e01-4cdd-a0f1-39ef587ff97e tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:02.942823 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0d94b7f6-4e01-4cdd-a0f1-39ef587ff97e tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:02.956562 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0d94b7f6-4e01-4cdd-a0f1-39ef587ff97e tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c" status: 200 len: 1676 microversion: 2.1 time: 0.299622 Sep 12 23:58:02.957751 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 266/538] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:58:02 2022] GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c => generated 1676 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:58:03.982607 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-eb5266ee-1062-479c-821c-28cd802d03f6 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:03.984772 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-eb5266ee-1062-479c-821c-28cd802d03f6 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:03.993680 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eb5266ee-1062-479c-821c-28cd802d03f6 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:03.993680 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eb5266ee-1062-479c-821c-28cd802d03f6 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:03.994005 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eb5266ee-1062-479c-821c-28cd802d03f6 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:03.995716 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eb5266ee-1062-479c-821c-28cd802d03f6 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:03.996313 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eb5266ee-1062-479c-821c-28cd802d03f6 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:03.996701 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eb5266ee-1062-479c-821c-28cd802d03f6 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:04.149634 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-eb5266ee-1062-479c-821c-28cd802d03f6 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:04.157813 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-eb5266ee-1062-479c-821c-28cd802d03f6 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c" status: 200 len: 1676 microversion: 2.1 time: 0.179900 Sep 12 23:58:04.158593 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 273/539] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:58:03 2022] GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c => generated 1676 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:58:05.182700 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e8757f90-6b57-4d7d-b7de-134fb2b28150 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:05.183540 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e8757f90-6b57-4d7d-b7de-134fb2b28150 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:05.192228 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e8757f90-6b57-4d7d-b7de-134fb2b28150 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:05.193307 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e8757f90-6b57-4d7d-b7de-134fb2b28150 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:05.194170 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e8757f90-6b57-4d7d-b7de-134fb2b28150 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:05.195528 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e8757f90-6b57-4d7d-b7de-134fb2b28150 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:05.196389 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e8757f90-6b57-4d7d-b7de-134fb2b28150 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:05.197216 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e8757f90-6b57-4d7d-b7de-134fb2b28150 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:05.347091 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e8757f90-6b57-4d7d-b7de-134fb2b28150 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:05.355613 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e8757f90-6b57-4d7d-b7de-134fb2b28150 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c" status: 200 len: 1676 microversion: 2.1 time: 0.176943 Sep 12 23:58:05.356470 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 267/540] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:58:05 2022] GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c => generated 1676 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:58:06.379365 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b2828987-9d76-4427-b977-0c1689705207 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:06.379993 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b2828987-9d76-4427-b977-0c1689705207 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:06.386932 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b2828987-9d76-4427-b977-0c1689705207 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:06.387445 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b2828987-9d76-4427-b977-0c1689705207 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:06.387877 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b2828987-9d76-4427-b977-0c1689705207 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:06.388564 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b2828987-9d76-4427-b977-0c1689705207 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:06.389011 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b2828987-9d76-4427-b977-0c1689705207 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:06.389465 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b2828987-9d76-4427-b977-0c1689705207 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:06.561293 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b2828987-9d76-4427-b977-0c1689705207 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:06.569530 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b2828987-9d76-4427-b977-0c1689705207 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c" status: 200 len: 1676 microversion: 2.1 time: 0.194016 Sep 12 23:58:06.570189 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 274/541] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:58:06 2022] GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c => generated 1676 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:58:07.596311 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4cf4da0b-1406-4cf5-a6b4-4187d7743120 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:07.596916 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-4cf4da0b-1406-4cf5-a6b4-4187d7743120 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:07.607297 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4cf4da0b-1406-4cf5-a6b4-4187d7743120 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:07.607924 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4cf4da0b-1406-4cf5-a6b4-4187d7743120 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:07.608407 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4cf4da0b-1406-4cf5-a6b4-4187d7743120 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:07.609208 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4cf4da0b-1406-4cf5-a6b4-4187d7743120 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:07.609671 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4cf4da0b-1406-4cf5-a6b4-4187d7743120 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:07.610089 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4cf4da0b-1406-4cf5-a6b4-4187d7743120 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:07.759319 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4cf4da0b-1406-4cf5-a6b4-4187d7743120 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:07.768288 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-4cf4da0b-1406-4cf5-a6b4-4187d7743120 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c" status: 200 len: 1676 microversion: 2.1 time: 0.177718 Sep 12 23:58:07.769044 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 268/542] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:58:07 2022] GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c => generated 1676 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:58:08.796064 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-533592fb-949d-435a-82ef-cc993ed4d374 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:08.796706 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-533592fb-949d-435a-82ef-cc993ed4d374 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:08.806598 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-533592fb-949d-435a-82ef-cc993ed4d374 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:08.807348 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-533592fb-949d-435a-82ef-cc993ed4d374 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:08.807787 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-533592fb-949d-435a-82ef-cc993ed4d374 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:08.808521 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-533592fb-949d-435a-82ef-cc993ed4d374 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:08.808924 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-533592fb-949d-435a-82ef-cc993ed4d374 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:08.809346 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-533592fb-949d-435a-82ef-cc993ed4d374 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:08.949106 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-533592fb-949d-435a-82ef-cc993ed4d374 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:08.957565 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-533592fb-949d-435a-82ef-cc993ed4d374 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c" status: 200 len: 1676 microversion: 2.1 time: 0.167077 Sep 12 23:58:08.958157 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 275/543] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:58:08 2022] GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c => generated 1676 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:58:09.982377 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9d3bdb72-4d51-42db-8c1f-cfa3efa933b4 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:09.983025 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9d3bdb72-4d51-42db-8c1f-cfa3efa933b4 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:09.990246 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9d3bdb72-4d51-42db-8c1f-cfa3efa933b4 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:09.991016 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9d3bdb72-4d51-42db-8c1f-cfa3efa933b4 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:09.991488 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9d3bdb72-4d51-42db-8c1f-cfa3efa933b4 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:09.992194 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9d3bdb72-4d51-42db-8c1f-cfa3efa933b4 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:09.992712 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9d3bdb72-4d51-42db-8c1f-cfa3efa933b4 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:09.993135 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9d3bdb72-4d51-42db-8c1f-cfa3efa933b4 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:10.166683 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-abb516e4-9bac-4e99-85bd-f5e9ca5b3957 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:10.167476 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-abb516e4-9bac-4e99-85bd-f5e9ca5b3957 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: f1ff4faa-6a45-4d62-9e44-80dba7a947c0] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:10.177308 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-abb516e4-9bac-4e99-85bd-f5e9ca5b3957 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:10.178178 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-abb516e4-9bac-4e99-85bd-f5e9ca5b3957 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:10.178984 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-abb516e4-9bac-4e99-85bd-f5e9ca5b3957 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:10.180276 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-abb516e4-9bac-4e99-85bd-f5e9ca5b3957 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:10.181133 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-abb516e4-9bac-4e99-85bd-f5e9ca5b3957 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:10.181881 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-abb516e4-9bac-4e99-85bd-f5e9ca5b3957 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:10.211132 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-9d3bdb72-4d51-42db-8c1f-cfa3efa933b4 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:10.222538 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-abb516e4-9bac-4e99-85bd-f5e9ca5b3957 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0/ips" status: 200 len: 151 microversion: 2.1 time: 0.060017 Sep 12 23:58:10.223600 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9d3bdb72-4d51-42db-8c1f-cfa3efa933b4 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c" status: 200 len: 1653 microversion: 2.1 time: 0.245081 Sep 12 23:58:10.224003 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 276/544] 10.222.0.26 () {58 vars in 1248 bytes} [Mon Sep 12 23:58:10 2022] GET /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0/ips => generated 151 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:58:10.232889 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 269/545] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:58:09 2022] GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c => generated 1653 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:58:10.250046 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-233ed758-2111-4418-bb8c-c1cb4051e345 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:58:10.258678 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-233ed758-2111-4418-bb8c-c1cb4051e345 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:10.259290 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-233ed758-2111-4418-bb8c-c1cb4051e345 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:10.260047 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-233ed758-2111-4418-bb8c-c1cb4051e345 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:10.290423 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-233ed758-2111-4418-bb8c-c1cb4051e345 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Going to try to start instance {{(pid=126975) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 12 23:58:10.341374 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-233ed758-2111-4418-bb8c-c1cb4051e345 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "POST /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c/action" status: 202 len: 0 microversion: 2.1 time: 0.098226 Sep 12 23:58:10.342651 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 277/546] 10.222.0.26 () {60 vars in 1278 bytes} [Mon Sep 12 23:58:10 2022] POST /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 23:58:10.353993 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1c5e4ba8-bf63-41f2-9998-ae9beb162226 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:10.354845 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1c5e4ba8-bf63-41f2-9998-ae9beb162226 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:10.366213 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1c5e4ba8-bf63-41f2-9998-ae9beb162226 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:10.366963 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1c5e4ba8-bf63-41f2-9998-ae9beb162226 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:10.367646 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1c5e4ba8-bf63-41f2-9998-ae9beb162226 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:10.368725 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1c5e4ba8-bf63-41f2-9998-ae9beb162226 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:10.370424 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1c5e4ba8-bf63-41f2-9998-ae9beb162226 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:10.371717 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1c5e4ba8-bf63-41f2-9998-ae9beb162226 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:10.703098 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-1c5e4ba8-bf63-41f2-9998-ae9beb162226 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:10.712758 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1c5e4ba8-bf63-41f2-9998-ae9beb162226 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c" status: 200 len: 1662 microversion: 2.1 time: 0.365235 Sep 12 23:58:10.713580 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 270/547] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:58:10 2022] GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c => generated 1662 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:58:11.634514 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9906b2fe-a92d-48ba-8f73-3d5d09618ae9 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dfca4b43-dc22-49f4-8278-1ba207d25e42"}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:58:11.637223 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9906b2fe-a92d-48ba-8f73-3d5d09618ae9 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: f1ff4faa-6a45-4d62-9e44-80dba7a947c0] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:11.645142 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9906b2fe-a92d-48ba-8f73-3d5d09618ae9 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:11.645659 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9906b2fe-a92d-48ba-8f73-3d5d09618ae9 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:11.646087 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9906b2fe-a92d-48ba-8f73-3d5d09618ae9 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:11.646797 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9906b2fe-a92d-48ba-8f73-3d5d09618ae9 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:11.647636 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9906b2fe-a92d-48ba-8f73-3d5d09618ae9 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:11.648057 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9906b2fe-a92d-48ba-8f73-3d5d09618ae9 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:11.738352 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-bb23fd55-e03b-4226-9163-b7b20fb4ba51 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:11.739149 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-bb23fd55-e03b-4226-9163-b7b20fb4ba51 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:11.749352 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bb23fd55-e03b-4226-9163-b7b20fb4ba51 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:11.749835 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bb23fd55-e03b-4226-9163-b7b20fb4ba51 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:11.750266 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bb23fd55-e03b-4226-9163-b7b20fb4ba51 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:11.750959 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bb23fd55-e03b-4226-9163-b7b20fb4ba51 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:11.751456 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bb23fd55-e03b-4226-9163-b7b20fb4ba51 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:11.751877 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bb23fd55-e03b-4226-9163-b7b20fb4ba51 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:11.892220 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-bb23fd55-e03b-4226-9163-b7b20fb4ba51 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:11.901119 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-bb23fd55-e03b-4226-9163-b7b20fb4ba51 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c" status: 200 len: 1662 microversion: 2.1 time: 0.168764 Sep 12 23:58:11.901908 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 271/548] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:58:11 2022] GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c => generated 1662 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:58:12.319412 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9906b2fe-a92d-48ba-8f73-3d5d09618ae9 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "POST /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.689942 Sep 12 23:58:12.320033 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 278/549] 10.222.0.26 () {60 vars in 1323 bytes} [Mon Sep 12 23:58:11 2022] POST /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0/os-volume_attachments => generated 194 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:58:12.927034 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b16f78a1-5e08-4ca1-959b-3bec9f40f18f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:12.928083 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b16f78a1-5e08-4ca1-959b-3bec9f40f18f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:12.936282 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b16f78a1-5e08-4ca1-959b-3bec9f40f18f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:12.936796 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b16f78a1-5e08-4ca1-959b-3bec9f40f18f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:12.937251 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b16f78a1-5e08-4ca1-959b-3bec9f40f18f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:12.937904 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b16f78a1-5e08-4ca1-959b-3bec9f40f18f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:12.938412 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b16f78a1-5e08-4ca1-959b-3bec9f40f18f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:12.938826 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b16f78a1-5e08-4ca1-959b-3bec9f40f18f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:13.076833 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b16f78a1-5e08-4ca1-959b-3bec9f40f18f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:13.085446 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b16f78a1-5e08-4ca1-959b-3bec9f40f18f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c" status: 200 len: 1666 microversion: 2.1 time: 0.164312 Sep 12 23:58:13.086047 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 272/550] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:58:12 2022] GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c => generated 1666 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:58:15.623733 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a7f7ecea-cffa-46be-afa5-364a014b4c0b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:15.624347 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a7f7ecea-cffa-46be-afa5-364a014b4c0b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 0be21a98-d3f6-4f26-8947-fd39015a7735] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:15.626368 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=38 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:58:15.632285 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a7f7ecea-cffa-46be-afa5-364a014b4c0b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:15.632777 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a7f7ecea-cffa-46be-afa5-364a014b4c0b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:15.633214 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a7f7ecea-cffa-46be-afa5-364a014b4c0b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:15.633918 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a7f7ecea-cffa-46be-afa5-364a014b4c0b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:15.634373 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a7f7ecea-cffa-46be-afa5-364a014b4c0b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:15.634825 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a7f7ecea-cffa-46be-afa5-364a014b4c0b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:15.730402 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.objects.instance [None req-a7f7ecea-cffa-46be-afa5-364a014b4c0b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lazy-loading 'services' on Instance uuid 0be21a98-d3f6-4f26-8947-fd39015a7735 {{(pid=126975) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 23:58:15.808615 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a7f7ecea-cffa-46be-afa5-364a014b4c0b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735/os-volume_attachments/ed40638a-976a-4031-9703-eea367213210" status: 202 len: 0 microversion: 2.1 time: 0.189921 Sep 12 23:58:15.809203 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 279/551] 10.222.0.26 () {58 vars in 1416 bytes} [Mon Sep 12 23:58:15 2022] DELETE /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735/os-volume_attachments/ed40638a-976a-4031-9703-eea367213210 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 23:58:15.817967 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9b68f1a4-0891-4a63-9905-ff0b014861de tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:15.820190 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9b68f1a4-0891-4a63-9905-ff0b014861de tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 0be21a98-d3f6-4f26-8947-fd39015a7735] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:15.826798 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9b68f1a4-0891-4a63-9905-ff0b014861de tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:15.827350 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9b68f1a4-0891-4a63-9905-ff0b014861de tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:15.827796 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9b68f1a4-0891-4a63-9905-ff0b014861de tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:15.828740 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9b68f1a4-0891-4a63-9905-ff0b014861de tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:15.829205 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9b68f1a4-0891-4a63-9905-ff0b014861de tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:15.829698 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9b68f1a4-0891-4a63-9905-ff0b014861de tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:15.861637 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9b68f1a4-0891-4a63-9905-ff0b014861de tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047620 Sep 12 23:58:15.862197 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 273/552] 10.222.0.26 () {58 vars in 1302 bytes} [Mon Sep 12 23:58:15 2022] GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:58:16.878883 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b3474052-c0b9-400b-bbf9-ad1c82fb69b6 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:16.881201 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b3474052-c0b9-400b-bbf9-ad1c82fb69b6 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 0be21a98-d3f6-4f26-8947-fd39015a7735] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:16.888306 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b3474052-c0b9-400b-bbf9-ad1c82fb69b6 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:16.888788 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b3474052-c0b9-400b-bbf9-ad1c82fb69b6 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:16.889221 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b3474052-c0b9-400b-bbf9-ad1c82fb69b6 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:16.889918 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b3474052-c0b9-400b-bbf9-ad1c82fb69b6 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:16.890372 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b3474052-c0b9-400b-bbf9-ad1c82fb69b6 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:16.890792 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b3474052-c0b9-400b-bbf9-ad1c82fb69b6 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:16.916876 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:58:16.923735 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b3474052-c0b9-400b-bbf9-ad1c82fb69b6 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051451 Sep 12 23:58:16.924299 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 280/553] 10.222.0.26 () {58 vars in 1302 bytes} [Mon Sep 12 23:58:16 2022] GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:58:17.938647 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c23d8987-9c05-4784-960e-cfe96fafe7f3 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:17.940960 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c23d8987-9c05-4784-960e-cfe96fafe7f3 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 0be21a98-d3f6-4f26-8947-fd39015a7735] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:17.948187 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c23d8987-9c05-4784-960e-cfe96fafe7f3 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:17.948706 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c23d8987-9c05-4784-960e-cfe96fafe7f3 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:17.949112 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c23d8987-9c05-4784-960e-cfe96fafe7f3 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:17.949855 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c23d8987-9c05-4784-960e-cfe96fafe7f3 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:17.950313 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c23d8987-9c05-4784-960e-cfe96fafe7f3 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:17.950764 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c23d8987-9c05-4784-960e-cfe96fafe7f3 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:17.953418 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:58:17.985518 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c23d8987-9c05-4784-960e-cfe96fafe7f3 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051043 Sep 12 23:58:17.986099 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 274/554] 10.222.0.26 () {58 vars in 1302 bytes} [Mon Sep 12 23:58:17 2022] GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:58:19.000350 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-189ab503-1576-4d84-b841-e9c002553148 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:19.003406 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-189ab503-1576-4d84-b841-e9c002553148 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 0be21a98-d3f6-4f26-8947-fd39015a7735] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:19.016513 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-189ab503-1576-4d84-b841-e9c002553148 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:19.017067 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-189ab503-1576-4d84-b841-e9c002553148 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:19.017507 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-189ab503-1576-4d84-b841-e9c002553148 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:19.018202 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-189ab503-1576-4d84-b841-e9c002553148 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:19.018648 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-189ab503-1576-4d84-b841-e9c002553148 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:19.019071 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-189ab503-1576-4d84-b841-e9c002553148 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:19.054032 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-189ab503-1576-4d84-b841-e9c002553148 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059397 Sep 12 23:58:19.054609 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 281/555] 10.222.0.26 () {58 vars in 1302 bytes} [Mon Sep 12 23:58:18 2022] GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:58:19.934083 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ec0d4860-05fc-47d4-98fd-396f79a6709b tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dfca4b43-dc22-49f4-8278-1ba207d25e42"}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:58:19.936543 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ec0d4860-05fc-47d4-98fd-396f79a6709b tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: f1ff4faa-6a45-4d62-9e44-80dba7a947c0] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:19.943382 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ec0d4860-05fc-47d4-98fd-396f79a6709b tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:19.943869 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ec0d4860-05fc-47d4-98fd-396f79a6709b tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:19.944323 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ec0d4860-05fc-47d4-98fd-396f79a6709b tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:19.944998 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ec0d4860-05fc-47d4-98fd-396f79a6709b tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:19.945462 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ec0d4860-05fc-47d4-98fd-396f79a6709b tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:19.945884 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ec0d4860-05fc-47d4-98fd-396f79a6709b tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:20.028749 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-ec0d4860-05fc-47d4-98fd-396f79a6709b tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] HTTP exception thrown: Invalid volume: volume dfca4b43-dc22-49f4-8278-1ba207d25e42 is already attached to instances: f1ff4faa-6a45-4d62-9e44-80dba7a947c0 Sep 12 23:58:20.030546 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ec0d4860-05fc-47d4-98fd-396f79a6709b tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Request method failure captured: Sep 12 23:58:20.030546 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: request: POST /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0/os-volume_attachments HTTP/1.1 Sep 12 23:58:20.030546 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Accept: application/json Sep 12 23:58:20.030546 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Sep 12 23:58:20.030546 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Connection: close Sep 12 23:58:20.030546 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Content-Length: 74 Sep 12 23:58:20.030546 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Content-Type: application/json Sep 12 23:58:20.030546 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Host: 10.222.0.26 Sep 12 23:58:20.030546 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Sep 12 23:58:20.030546 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Sep 12 23:58:20.030546 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjH8Z2hSl_dF3G_DVeQeMffC839mjKCX1ldHy7KYxwLbzxfI-Hnili9xft2wG7WgRYfuNYC0jIjSduHyiAWMPed8uo_fiAxdNKw8dFJEFK0lHOKo1_8VeXMUxxHgYF50XY0v_lkkNk_ejqmvpqtZKiNqfO8LXenu9zNmJy4upaAKztdpU Sep 12 23:58:20.030546 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Sep 12 23:58:20.030546 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Sep 12 23:58:20.030546 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Sep 12 23:58:20.030546 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Sep 12 23:58:20.030546 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Sep 12 23:58:20.030546 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Sep 12 23:58:20.030546 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Id: 6c681f1232de4a5fbfc728c230f80624 Sep 12 23:58:20.030546 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-AttachVolumeNegativeTest-1965954712 Sep 12 23:58:20.030546 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Role: member,reader Sep 12 23:58:20.030546 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Roles: member,reader Sep 12 23:58:20.032208 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6c681f1232de4a5fbfc728c230f80624"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6c681f1232de4a5fbfc728c230f80624"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6c681f1232de4a5fbfc728c230f80624"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6c681f1232de4a5fbfc728c230f80624"}]}] Sep 12 23:58:20.032208 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-AttachVolumeNegativeTest-1965954712 Sep 12 23:58:20.032208 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant-Id: 6c681f1232de4a5fbfc728c230f80624 Sep 12 23:58:20.032208 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1965954712 Sep 12 23:58:20.032208 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User: tempest-AttachVolumeNegativeTest-1965954712-project Sep 12 23:58:20.032208 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Sep 12 23:58:20.032208 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Sep 12 23:58:20.032208 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Id: a8cbfc74644f4d4594a70b833ad7002c Sep 12 23:58:20.032208 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-AttachVolumeNegativeTest-1965954712-project Sep 12 23:58:20.032208 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Sep 12 23:58:20.032208 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: {"volumeAttachment": {"volumeId": "dfca4b43-dc22-49f4-8278-1ba207d25e42"}} Sep 12 23:58:20.032208 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: method: > Sep 12 23:58:20.033157 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: exception: Invalid volume: volume dfca4b43-dc22-49f4-8278-1ba207d25e42 is already attached to instances: f1ff4faa-6a45-4d62-9e44-80dba7a947c0 Sep 12 23:58:20.033157 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: action_args: {'server_id': 'f1ff4faa-6a45-4d62-9e44-80dba7a947c0', 'body': {'volumeAttachment': {'volumeId': 'dfca4b43-dc22-49f4-8278-1ba207d25e42'}}} Sep 12 23:58:20.033157 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:58:20.033157 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:58:20.033157 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 12 23:58:20.033157 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 12 23:58:20.033157 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 12 23:58:20.033157 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 12 23:58:20.033157 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 12 23:58:20.033157 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 12 23:58:20.033157 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 12 23:58:20.033157 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 12 23:58:20.033157 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 12 23:58:20.033157 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 12 23:58:20.033157 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume dfca4b43-dc22-49f4-8278-1ba207d25e42 is already attached to instances: f1ff4faa-6a45-4d62-9e44-80dba7a947c0 Sep 12 23:58:20.033157 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:58:20.033157 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:58:20.033157 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:58:20.033157 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:58:20.034570 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:58:20.034570 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:58:20.034570 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:58:20.034570 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:58:20.034570 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:58:20.034570 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:58:20.034570 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 12 23:58:20.034570 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 12 23:58:20.034570 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 12 23:58:20.034570 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 12 23:58:20.034570 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 12 23:58:20.034570 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 12 23:58:20.034570 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 12 23:58:20.034570 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 12 23:58:20.034570 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume dfca4b43-dc22-49f4-8278-1ba207d25e42 is already attached to instances: f1ff4faa-6a45-4d62-9e44-80dba7a947c0 Sep 12 23:58:20.034570 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:58:20.034570 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:58:20.034570 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:58:20.034570 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:58:20.034570 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:58:20.036143 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:58:20.036143 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:58:20.036143 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:58:20.036143 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume dfca4b43-dc22-49f4-8278-1ba207d25e42 is already attached to instances: f1ff4faa-6a45-4d62-9e44-80dba7a947c0 Sep 12 23:58:20.036143 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:58:20.036143 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ec0d4860-05fc-47d4-98fd-396f79a6709b tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Returning 400 to user: Invalid volume: volume dfca4b43-dc22-49f4-8278-1ba207d25e42 is already attached to instances: f1ff4faa-6a45-4d62-9e44-80dba7a947c0 {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:58:20.036143 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ec0d4860-05fc-47d4-98fd-396f79a6709b tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "POST /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102100 Sep 12 23:58:20.036143 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 275/556] 10.222.0.26 () {60 vars in 1323 bytes} [Mon Sep 12 23:58:19 2022] POST /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 12 23:58:20.066515 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-eda0b1a5-a1af-472b-9aea-1ef9e7f7a7f8 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:20.069630 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-eda0b1a5-a1af-472b-9aea-1ef9e7f7a7f8 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 0be21a98-d3f6-4f26-8947-fd39015a7735] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:20.078754 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eda0b1a5-a1af-472b-9aea-1ef9e7f7a7f8 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:20.079277 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eda0b1a5-a1af-472b-9aea-1ef9e7f7a7f8 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:20.079750 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eda0b1a5-a1af-472b-9aea-1ef9e7f7a7f8 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:20.080455 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eda0b1a5-a1af-472b-9aea-1ef9e7f7a7f8 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:20.080902 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eda0b1a5-a1af-472b-9aea-1ef9e7f7a7f8 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:20.081583 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-eda0b1a5-a1af-472b-9aea-1ef9e7f7a7f8 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:20.109372 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2cb282a9-367b-4e71-8348-a0dee6703348 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:20.109866 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2cb282a9-367b-4e71-8348-a0dee6703348 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: f1ff4faa-6a45-4d62-9e44-80dba7a947c0] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:20.116073 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-eda0b1a5-a1af-472b-9aea-1ef9e7f7a7f8 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053507 Sep 12 23:58:20.116330 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2cb282a9-367b-4e71-8348-a0dee6703348 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:20.116633 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2cb282a9-367b-4e71-8348-a0dee6703348 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:20.116751 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 282/557] 10.222.0.26 () {58 vars in 1302 bytes} [Mon Sep 12 23:58:20 2022] GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 12 23:58:20.117060 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2cb282a9-367b-4e71-8348-a0dee6703348 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:20.117759 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2cb282a9-367b-4e71-8348-a0dee6703348 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:20.118228 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2cb282a9-367b-4e71-8348-a0dee6703348 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:20.118607 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2cb282a9-367b-4e71-8348-a0dee6703348 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:20.227286 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.objects.instance [None req-2cb282a9-367b-4e71-8348-a0dee6703348 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lazy-loading 'services' on Instance uuid f1ff4faa-6a45-4d62-9e44-80dba7a947c0 {{(pid=126976) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 23:58:20.233720 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2c961fed-b8bb-49fb-8556-d6b996192b63 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:20.234132 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2c961fed-b8bb-49fb-8556-d6b996192b63 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 0be21a98-d3f6-4f26-8947-fd39015a7735] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:20.240659 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2c961fed-b8bb-49fb-8556-d6b996192b63 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:20.241146 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2c961fed-b8bb-49fb-8556-d6b996192b63 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:20.241579 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2c961fed-b8bb-49fb-8556-d6b996192b63 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:20.242284 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2c961fed-b8bb-49fb-8556-d6b996192b63 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:20.242827 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2c961fed-b8bb-49fb-8556-d6b996192b63 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:20.243271 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2c961fed-b8bb-49fb-8556-d6b996192b63 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:20.270194 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2c961fed-b8bb-49fb-8556-d6b996192b63 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 0be21a98-d3f6-4f26-8947-fd39015a7735] Going to try to terminate instance {{(pid=126975) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 23:58:20.303965 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2cb282a9-367b-4e71-8348-a0dee6703348 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0/os-volume_attachments/dfca4b43-dc22-49f4-8278-1ba207d25e42" status: 202 len: 0 microversion: 2.1 time: 0.198410 Sep 12 23:58:20.304634 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 276/558] 10.222.0.26 () {58 vars in 1416 bytes} [Mon Sep 12 23:58:20 2022] DELETE /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0/os-volume_attachments/dfca4b43-dc22-49f4-8278-1ba207d25e42 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 12 23:58:20.319146 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a029f0f7-de75-48a0-a968-ca0cc7134bff tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:20.329661 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a029f0f7-de75-48a0-a968-ca0cc7134bff tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: f1ff4faa-6a45-4d62-9e44-80dba7a947c0] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:20.347717 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a029f0f7-de75-48a0-a968-ca0cc7134bff tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:20.348221 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a029f0f7-de75-48a0-a968-ca0cc7134bff tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:20.352019 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a029f0f7-de75-48a0-a968-ca0cc7134bff tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:20.352770 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a029f0f7-de75-48a0-a968-ca0cc7134bff tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:20.353558 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a029f0f7-de75-48a0-a968-ca0cc7134bff tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:20.353692 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a029f0f7-de75-48a0-a968-ca0cc7134bff tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:20.368555 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2c961fed-b8bb-49fb-8556-d6b996192b63 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735" status: 204 len: 0 microversion: 2.1 time: 0.138535 Sep 12 23:58:20.372668 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 283/559] 10.222.0.26 () {58 vars in 1239 bytes} [Mon Sep 12 23:58:20 2022] DELETE /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 12 23:58:20.378962 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f73e44bc-592b-4508-b6ac-f7d849a69150 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:20.379712 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f73e44bc-592b-4508-b6ac-f7d849a69150 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 0be21a98-d3f6-4f26-8947-fd39015a7735] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:20.388458 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f73e44bc-592b-4508-b6ac-f7d849a69150 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:20.389022 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f73e44bc-592b-4508-b6ac-f7d849a69150 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:20.389757 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f73e44bc-592b-4508-b6ac-f7d849a69150 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:20.390991 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f73e44bc-592b-4508-b6ac-f7d849a69150 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:20.391600 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f73e44bc-592b-4508-b6ac-f7d849a69150 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:20.391998 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f73e44bc-592b-4508-b6ac-f7d849a69150 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:20.394722 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a029f0f7-de75-48a0-a968-ca0cc7134bff tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082961 Sep 12 23:58:20.396062 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 277/560] 10.222.0.26 () {58 vars in 1302 bytes} [Mon Sep 12 23:58:20 2022] GET /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 23:58:20.552004 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f73e44bc-592b-4508-b6ac-f7d849a69150 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:20.560256 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f73e44bc-592b-4508-b6ac-f7d849a69150 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735" status: 200 len: 1689 microversion: 2.1 time: 0.185643 Sep 12 23:58:20.560854 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 284/561] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:58:20 2022] GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735 => generated 1689 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:58:21.409760 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3ede6848-91b6-482a-ae47-d4f02b29b972 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:21.412172 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3ede6848-91b6-482a-ae47-d4f02b29b972 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: f1ff4faa-6a45-4d62-9e44-80dba7a947c0] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:21.419186 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3ede6848-91b6-482a-ae47-d4f02b29b972 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:21.419709 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3ede6848-91b6-482a-ae47-d4f02b29b972 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:21.420168 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3ede6848-91b6-482a-ae47-d4f02b29b972 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:21.420876 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3ede6848-91b6-482a-ae47-d4f02b29b972 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:21.421349 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3ede6848-91b6-482a-ae47-d4f02b29b972 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:21.421773 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3ede6848-91b6-482a-ae47-d4f02b29b972 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:21.453736 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3ede6848-91b6-482a-ae47-d4f02b29b972 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048253 Sep 12 23:58:21.454470 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 278/562] 10.222.0.26 () {58 vars in 1302 bytes} [Mon Sep 12 23:58:21 2022] GET /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:58:21.584115 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b61876e4-1b4a-4328-8bb3-d5095e8f6b98 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:21.584714 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b61876e4-1b4a-4328-8bb3-d5095e8f6b98 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 0be21a98-d3f6-4f26-8947-fd39015a7735] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:21.591817 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b61876e4-1b4a-4328-8bb3-d5095e8f6b98 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:21.592179 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b61876e4-1b4a-4328-8bb3-d5095e8f6b98 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:21.592581 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b61876e4-1b4a-4328-8bb3-d5095e8f6b98 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:21.593287 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b61876e4-1b4a-4328-8bb3-d5095e8f6b98 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:21.593740 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b61876e4-1b4a-4328-8bb3-d5095e8f6b98 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:21.594164 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b61876e4-1b4a-4328-8bb3-d5095e8f6b98 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:21.732935 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b61876e4-1b4a-4328-8bb3-d5095e8f6b98 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:21.742037 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b61876e4-1b4a-4328-8bb3-d5095e8f6b98 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735" status: 200 len: 1689 microversion: 2.1 time: 0.161814 Sep 12 23:58:21.742634 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 285/563] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:58:21 2022] GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735 => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:58:22.467593 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-54a845a3-a7e9-497f-a868-d2e18a28b23d tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:22.469790 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-54a845a3-a7e9-497f-a868-d2e18a28b23d tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: f1ff4faa-6a45-4d62-9e44-80dba7a947c0] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:22.476594 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-54a845a3-a7e9-497f-a868-d2e18a28b23d tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:22.477080 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-54a845a3-a7e9-497f-a868-d2e18a28b23d tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:22.477510 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-54a845a3-a7e9-497f-a868-d2e18a28b23d tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:22.478239 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-54a845a3-a7e9-497f-a868-d2e18a28b23d tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:22.478667 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-54a845a3-a7e9-497f-a868-d2e18a28b23d tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:22.479081 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-54a845a3-a7e9-497f-a868-d2e18a28b23d tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:22.513927 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-54a845a3-a7e9-497f-a868-d2e18a28b23d tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050476 Sep 12 23:58:22.514498 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 279/564] 10.222.0.26 () {58 vars in 1302 bytes} [Mon Sep 12 23:58:22 2022] GET /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:58:22.765009 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-81183090-08eb-493b-a641-5c5d23457c45 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:22.765576 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-81183090-08eb-493b-a641-5c5d23457c45 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 0be21a98-d3f6-4f26-8947-fd39015a7735] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:22.772926 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-81183090-08eb-493b-a641-5c5d23457c45 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:22.773400 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-81183090-08eb-493b-a641-5c5d23457c45 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:22.773833 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-81183090-08eb-493b-a641-5c5d23457c45 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:22.774559 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-81183090-08eb-493b-a641-5c5d23457c45 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:22.774993 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-81183090-08eb-493b-a641-5c5d23457c45 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:22.775462 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-81183090-08eb-493b-a641-5c5d23457c45 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:22.929814 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-81183090-08eb-493b-a641-5c5d23457c45 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:22.940511 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-81183090-08eb-493b-a641-5c5d23457c45 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735" status: 200 len: 1689 microversion: 2.1 time: 0.179490 Sep 12 23:58:22.941104 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 286/565] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:58:22 2022] GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735 => generated 1689 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:58:23.527586 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6cef6097-63b7-4d02-ad71-bc011871daf0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:23.529706 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6cef6097-63b7-4d02-ad71-bc011871daf0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: f1ff4faa-6a45-4d62-9e44-80dba7a947c0] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:23.537297 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6cef6097-63b7-4d02-ad71-bc011871daf0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:23.538097 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6cef6097-63b7-4d02-ad71-bc011871daf0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:23.538837 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6cef6097-63b7-4d02-ad71-bc011871daf0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:23.539985 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6cef6097-63b7-4d02-ad71-bc011871daf0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:23.540704 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6cef6097-63b7-4d02-ad71-bc011871daf0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:23.541430 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6cef6097-63b7-4d02-ad71-bc011871daf0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:23.573763 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6cef6097-63b7-4d02-ad71-bc011871daf0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050267 Sep 12 23:58:23.574333 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 280/566] 10.222.0.26 () {58 vars in 1302 bytes} [Mon Sep 12 23:58:23 2022] GET /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:58:23.964097 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-fdb9e8a0-e717-482b-ab05-9e65d9ee82b6 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:23.964717 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-fdb9e8a0-e717-482b-ab05-9e65d9ee82b6 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 0be21a98-d3f6-4f26-8947-fd39015a7735] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:23.971664 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fdb9e8a0-e717-482b-ab05-9e65d9ee82b6 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:23.972055 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fdb9e8a0-e717-482b-ab05-9e65d9ee82b6 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:23.972519 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fdb9e8a0-e717-482b-ab05-9e65d9ee82b6 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:23.973189 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fdb9e8a0-e717-482b-ab05-9e65d9ee82b6 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:23.973640 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fdb9e8a0-e717-482b-ab05-9e65d9ee82b6 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:23.974051 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fdb9e8a0-e717-482b-ab05-9e65d9ee82b6 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:24.120513 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-fdb9e8a0-e717-482b-ab05-9e65d9ee82b6 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:24.130748 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-fdb9e8a0-e717-482b-ab05-9e65d9ee82b6 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735" status: 200 len: 1689 microversion: 2.1 time: 0.169750 Sep 12 23:58:24.130748 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 287/567] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:58:23 2022] GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735 => generated 1689 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:58:24.589602 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-35ff9489-af2c-4f07-9212-5a611338b252 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:24.593247 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-35ff9489-af2c-4f07-9212-5a611338b252 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: f1ff4faa-6a45-4d62-9e44-80dba7a947c0] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:24.599480 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:58:24.606876 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-35ff9489-af2c-4f07-9212-5a611338b252 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:24.607777 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-35ff9489-af2c-4f07-9212-5a611338b252 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:24.608535 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-35ff9489-af2c-4f07-9212-5a611338b252 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:24.609798 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-35ff9489-af2c-4f07-9212-5a611338b252 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:24.610653 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-35ff9489-af2c-4f07-9212-5a611338b252 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:24.611453 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-35ff9489-af2c-4f07-9212-5a611338b252 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:24.649347 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-35ff9489-af2c-4f07-9212-5a611338b252 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066369 Sep 12 23:58:24.649922 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 281/568] 10.222.0.26 () {58 vars in 1302 bytes} [Mon Sep 12 23:58:24 2022] GET /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 12 23:58:24.734456 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f1da2764-b901-423f-8c01-c13bd3861a10 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:24.735378 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f1da2764-b901-423f-8c01-c13bd3861a10 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: f1ff4faa-6a45-4d62-9e44-80dba7a947c0] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:24.746639 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f1da2764-b901-423f-8c01-c13bd3861a10 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:24.747548 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f1da2764-b901-423f-8c01-c13bd3861a10 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:24.748342 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f1da2764-b901-423f-8c01-c13bd3861a10 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:24.749631 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f1da2764-b901-423f-8c01-c13bd3861a10 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:24.750471 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f1da2764-b901-423f-8c01-c13bd3861a10 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:24.751253 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f1da2764-b901-423f-8c01-c13bd3861a10 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:24.797919 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f1da2764-b901-423f-8c01-c13bd3861a10 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: f1ff4faa-6a45-4d62-9e44-80dba7a947c0] Going to try to terminate instance {{(pid=126975) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 23:58:24.911825 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f1da2764-b901-423f-8c01-c13bd3861a10 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0" status: 204 len: 0 microversion: 2.1 time: 0.184527 Sep 12 23:58:24.912446 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 288/569] 10.222.0.26 () {58 vars in 1239 bytes} [Mon Sep 12 23:58:24 2022] DELETE /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 12 23:58:24.922706 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f59da2e2-95d0-4a98-bf8a-999c3791a3b9 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:24.923961 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f59da2e2-95d0-4a98-bf8a-999c3791a3b9 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: f1ff4faa-6a45-4d62-9e44-80dba7a947c0] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:24.932649 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f59da2e2-95d0-4a98-bf8a-999c3791a3b9 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:24.933978 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f59da2e2-95d0-4a98-bf8a-999c3791a3b9 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:24.934651 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f59da2e2-95d0-4a98-bf8a-999c3791a3b9 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:24.935637 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f59da2e2-95d0-4a98-bf8a-999c3791a3b9 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:24.936146 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f59da2e2-95d0-4a98-bf8a-999c3791a3b9 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:24.936632 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f59da2e2-95d0-4a98-bf8a-999c3791a3b9 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:25.154553 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8135e25a-8220-40f5-a7fa-13f3468d1a07 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:25.155305 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8135e25a-8220-40f5-a7fa-13f3468d1a07 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 0be21a98-d3f6-4f26-8947-fd39015a7735] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:25.163597 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8135e25a-8220-40f5-a7fa-13f3468d1a07 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:25.164099 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8135e25a-8220-40f5-a7fa-13f3468d1a07 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:25.164540 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8135e25a-8220-40f5-a7fa-13f3468d1a07 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:25.165263 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8135e25a-8220-40f5-a7fa-13f3468d1a07 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:25.166516 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8135e25a-8220-40f5-a7fa-13f3468d1a07 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:25.168112 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8135e25a-8220-40f5-a7fa-13f3468d1a07 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:25.199873 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f59da2e2-95d0-4a98-bf8a-999c3791a3b9 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:25.224043 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f59da2e2-95d0-4a98-bf8a-999c3791a3b9 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0" status: 200 len: 1680 microversion: 2.1 time: 0.304993 Sep 12 23:58:25.225025 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 282/570] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:58:24 2022] GET /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0 => generated 1680 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:58:25.304424 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8135e25a-8220-40f5-a7fa-13f3468d1a07 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:25.312905 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8135e25a-8220-40f5-a7fa-13f3468d1a07 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735" status: 200 len: 1621 microversion: 2.1 time: 0.162665 Sep 12 23:58:25.313514 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 289/571] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:58:25 2022] GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735 => generated 1621 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:58:25.611038 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-e2e096fa-db9d-448c-a1cd-e39a22941c90 req-49f4526a-e406-46ca-bc46-122a71a34906 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0be21a98-d3f6-4f26-8947-fd39015a7735", "name": "network-vif-deleted", "tag": "36b2ab7e-5dbe-4019-ae5e-f401a7d7cdb1"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:58:25.630277 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-e2e096fa-db9d-448c-a1cd-e39a22941c90 req-49f4526a-e406-46ca-bc46-122a71a34906 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:25.630975 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-e2e096fa-db9d-448c-a1cd-e39a22941c90 req-49f4526a-e406-46ca-bc46-122a71a34906 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:25.631638 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-e2e096fa-db9d-448c-a1cd-e39a22941c90 req-49f4526a-e406-46ca-bc46-122a71a34906 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:25.649701 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-e2e096fa-db9d-448c-a1cd-e39a22941c90 req-49f4526a-e406-46ca-bc46-122a71a34906 service nova] Creating event network-vif-deleted:36b2ab7e-5dbe-4019-ae5e-f401a7d7cdb1 for instance 0be21a98-d3f6-4f26-8947-fd39015a7735 on hv-cinder-82002 Sep 12 23:58:25.657566 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-e2e096fa-db9d-448c-a1cd-e39a22941c90 req-49f4526a-e406-46ca-bc46-122a71a34906 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051941 Sep 12 23:58:25.658459 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 283/572] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:58:26.253706 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9779e866-4265-459d-80e3-0067501c5a68 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:26.254611 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9779e866-4265-459d-80e3-0067501c5a68 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: f1ff4faa-6a45-4d62-9e44-80dba7a947c0] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:26.264570 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9779e866-4265-459d-80e3-0067501c5a68 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:26.265412 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9779e866-4265-459d-80e3-0067501c5a68 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:26.266180 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9779e866-4265-459d-80e3-0067501c5a68 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:26.267627 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9779e866-4265-459d-80e3-0067501c5a68 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:26.268476 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9779e866-4265-459d-80e3-0067501c5a68 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:26.269385 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9779e866-4265-459d-80e3-0067501c5a68 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:26.343020 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-408b8100-1bdb-4ce2-afd3-889d7a86649c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:26.344501 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-408b8100-1bdb-4ce2-afd3-889d7a86649c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 0be21a98-d3f6-4f26-8947-fd39015a7735] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:26.356698 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-408b8100-1bdb-4ce2-afd3-889d7a86649c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:26.357838 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-408b8100-1bdb-4ce2-afd3-889d7a86649c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:26.358686 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-408b8100-1bdb-4ce2-afd3-889d7a86649c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:26.360014 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-408b8100-1bdb-4ce2-afd3-889d7a86649c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:26.361097 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-408b8100-1bdb-4ce2-afd3-889d7a86649c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:26.361910 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-408b8100-1bdb-4ce2-afd3-889d7a86649c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:26.495053 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-408b8100-1bdb-4ce2-afd3-889d7a86649c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:26.507428 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-408b8100-1bdb-4ce2-afd3-889d7a86649c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735" status: 200 len: 1621 microversion: 2.1 time: 0.173684 Sep 12 23:58:26.508262 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 284/573] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:58:26 2022] GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735 => generated 1621 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:58:26.549118 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9779e866-4265-459d-80e3-0067501c5a68 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:26.558666 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9779e866-4265-459d-80e3-0067501c5a68 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0" status: 200 len: 1680 microversion: 2.1 time: 0.309592 Sep 12 23:58:26.559530 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 290/574] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:58:26 2022] GET /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0 => generated 1680 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:58:27.548593 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-bcde2d48-e2c5-4fea-b61e-9958edefbd61 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:27.550070 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-bcde2d48-e2c5-4fea-b61e-9958edefbd61 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 0be21a98-d3f6-4f26-8947-fd39015a7735] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:27.558287 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bcde2d48-e2c5-4fea-b61e-9958edefbd61 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:27.558774 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bcde2d48-e2c5-4fea-b61e-9958edefbd61 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:27.559457 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bcde2d48-e2c5-4fea-b61e-9958edefbd61 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:27.560181 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bcde2d48-e2c5-4fea-b61e-9958edefbd61 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:27.560623 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bcde2d48-e2c5-4fea-b61e-9958edefbd61 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:27.561279 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bcde2d48-e2c5-4fea-b61e-9958edefbd61 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:27.589182 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9ee038ef-592b-4b51-abd1-3e6965a80ca0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:27.590822 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9ee038ef-592b-4b51-abd1-3e6965a80ca0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: f1ff4faa-6a45-4d62-9e44-80dba7a947c0] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:27.604147 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9ee038ef-592b-4b51-abd1-3e6965a80ca0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:27.605110 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9ee038ef-592b-4b51-abd1-3e6965a80ca0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:27.605960 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9ee038ef-592b-4b51-abd1-3e6965a80ca0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:27.606991 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9ee038ef-592b-4b51-abd1-3e6965a80ca0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:27.607854 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9ee038ef-592b-4b51-abd1-3e6965a80ca0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:27.609191 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9ee038ef-592b-4b51-abd1-3e6965a80ca0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:27.610176 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bcde2d48-e2c5-4fea-b61e-9958edefbd61 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:27.610815 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bcde2d48-e2c5-4fea-b61e-9958edefbd61 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:27.611469 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bcde2d48-e2c5-4fea-b61e-9958edefbd61 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:27.612057 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.objects.instance [None req-bcde2d48-e2c5-4fea-b61e-9958edefbd61 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lazy-loading 'fault' on Instance uuid 0be21a98-d3f6-4f26-8947-fd39015a7735 {{(pid=126976) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 23:58:27.697898 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-bcde2d48-e2c5-4fea-b61e-9958edefbd61 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:27.714696 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-bcde2d48-e2c5-4fea-b61e-9958edefbd61 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735" status: 200 len: 1335 microversion: 2.1 time: 0.166992 Sep 12 23:58:27.714696 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 285/575] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:58:27 2022] GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735 => generated 1335 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:58:28.228654 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9ee038ef-592b-4b51-abd1-3e6965a80ca0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:28.238065 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9ee038ef-592b-4b51-abd1-3e6965a80ca0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0" status: 200 len: 1680 microversion: 2.1 time: 0.656240 Sep 12 23:58:28.238065 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 291/576] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:58:27 2022] GET /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0 => generated 1680 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:58:28.745974 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7a9de12e-1a1c-4418-915a-77810687cd02 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:28.749392 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-fa9997a9-24a8-433d-8cc4-1033da0b8a95 req-ff324e9a-78d7-455d-8523-9ebfd1192b4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1ff4faa-6a45-4d62-9e44-80dba7a947c0", "name": "network-vif-deleted", "tag": "cd5278d3-b6b8-4ed3-ba84-c102f2c6a074"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:58:28.752205 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7a9de12e-1a1c-4418-915a-77810687cd02 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 0be21a98-d3f6-4f26-8947-fd39015a7735] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:28.762048 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7a9de12e-1a1c-4418-915a-77810687cd02 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:28.762956 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7a9de12e-1a1c-4418-915a-77810687cd02 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:28.763915 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7a9de12e-1a1c-4418-915a-77810687cd02 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:28.764873 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7a9de12e-1a1c-4418-915a-77810687cd02 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:28.765449 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-fa9997a9-24a8-433d-8cc4-1033da0b8a95 req-ff324e9a-78d7-455d-8523-9ebfd1192b4e service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:28.765932 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-fa9997a9-24a8-433d-8cc4-1033da0b8a95 req-ff324e9a-78d7-455d-8523-9ebfd1192b4e service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:28.766200 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7a9de12e-1a1c-4418-915a-77810687cd02 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:28.766351 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-fa9997a9-24a8-433d-8cc4-1033da0b8a95 req-ff324e9a-78d7-455d-8523-9ebfd1192b4e service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:28.767573 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7a9de12e-1a1c-4418-915a-77810687cd02 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:28.788379 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-fa9997a9-24a8-433d-8cc4-1033da0b8a95 req-ff324e9a-78d7-455d-8523-9ebfd1192b4e service nova] Creating event network-vif-deleted:cd5278d3-b6b8-4ed3-ba84-c102f2c6a074 for instance f1ff4faa-6a45-4d62-9e44-80dba7a947c0 on hv-cinder-82002 Sep 12 23:58:28.790595 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-7a9de12e-1a1c-4418-915a-77810687cd02 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] HTTP exception thrown: Instance 0be21a98-d3f6-4f26-8947-fd39015a7735 could not be found. Sep 12 23:58:28.792817 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7a9de12e-1a1c-4418-915a-77810687cd02 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Request method failure captured: Sep 12 23:58:28.792817 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: request: GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735 HTTP/1.1 Sep 12 23:58:28.792817 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Accept: application/json Sep 12 23:58:28.792817 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Sep 12 23:58:28.792817 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Connection: close Sep 12 23:58:28.792817 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Content-Length: 0 Sep 12 23:58:28.792817 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Content-Type: application/json Sep 12 23:58:28.792817 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Host: 10.222.0.26 Sep 12 23:58:28.792817 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Sep 12 23:58:28.792817 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Sep 12 23:58:28.792817 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjH8ZuStW1XXoPQe5y95eOpKYZF0F7YBvJw_27e2kYLBySngK1oyC8cbK16WrSBBy5I-zldm72baODkX7E0kbSH3YQJRovD2YiBAj_9m-miREAelhxMrO-4StKyBWO2wiypQKnAsHCgsduOcFVztxSrPSWmh7ZuLOXLc3LDIycAkgHl0E Sep 12 23:58:28.792817 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Sep 12 23:58:28.792817 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Sep 12 23:58:28.792817 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Sep 12 23:58:28.792817 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Sep 12 23:58:28.792817 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Sep 12 23:58:28.792817 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Sep 12 23:58:28.792817 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Id: 6c458cf41ded4113a09fb07e10d81d39 Sep 12 23:58:28.792817 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2096714212 Sep 12 23:58:28.792817 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Role: member,reader Sep 12 23:58:28.792817 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Roles: member,reader Sep 12 23:58:28.794430 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6c458cf41ded4113a09fb07e10d81d39"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6c458cf41ded4113a09fb07e10d81d39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6c458cf41ded4113a09fb07e10d81d39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6c458cf41ded4113a09fb07e10d81d39"}]}] Sep 12 23:58:28.794430 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2096714212 Sep 12 23:58:28.794430 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant-Id: 6c458cf41ded4113a09fb07e10d81d39 Sep 12 23:58:28.794430 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2096714212 Sep 12 23:58:28.794430 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User: tempest-ServerRescueNegativeTestJSON-2096714212-project Sep 12 23:58:28.794430 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Sep 12 23:58:28.794430 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Sep 12 23:58:28.794430 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Id: 76eb39c2010e43aaa0a01caaea3a38b9 Sep 12 23:58:28.794430 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2096714212-project Sep 12 23:58:28.794430 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: method: > Sep 12 23:58:28.794430 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: exception: Instance 0be21a98-d3f6-4f26-8947-fd39015a7735 could not be found. Sep 12 23:58:28.794430 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: action_args: {'id': '0be21a98-d3f6-4f26-8947-fd39015a7735'} Sep 12 23:58:28.795189 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:58:28.795189 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:58:28.795189 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:58:28.795189 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:58:28.795189 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:58:28.795189 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:58:28.795189 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:58:28.795189 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:58:28.795189 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:58:28.795189 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:58:28.795189 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0be21a98-d3f6-4f26-8947-fd39015a7735 could not be found. Sep 12 23:58:28.795189 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:58:28.795189 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:58:28.795189 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:58:28.795189 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:58:28.795189 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:58:28.795189 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:58:28.795189 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:58:28.795189 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:58:28.795189 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:58:28.796477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:58:28.796477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 23:58:28.796477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 23:58:28.796477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:58:28.796477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:58:28.796477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:58:28.796477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:58:28.796477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0be21a98-d3f6-4f26-8947-fd39015a7735 could not be found. Sep 12 23:58:28.796477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:58:28.796477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:58:28.796477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:58:28.796477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:58:28.796477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:58:28.796477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:58:28.796477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:58:28.796477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:58:28.796477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0be21a98-d3f6-4f26-8947-fd39015a7735 could not be found. Sep 12 23:58:28.796477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:58:28.797594 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-fa9997a9-24a8-433d-8cc4-1033da0b8a95 req-ff324e9a-78d7-455d-8523-9ebfd1192b4e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054657 Sep 12 23:58:28.799181 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 292/577] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:58:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 23:58:28.799928 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7a9de12e-1a1c-4418-915a-77810687cd02 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Returning 404 to user: Instance 0be21a98-d3f6-4f26-8947-fd39015a7735 could not be found. {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:58:28.802258 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7a9de12e-1a1c-4418-915a-77810687cd02 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735" status: 404 len: 111 microversion: 2.1 time: 0.068561 Sep 12 23:58:28.810175 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 286/578] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:58:28 2022] GET /compute/v2.1/servers/0be21a98-d3f6-4f26-8947-fd39015a7735 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:58:28.822922 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e4935ab5-7248-4ec7-8d5b-4b8b61cb3153 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '.version_select at 0x7fed01460b80>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:28.861945 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e4935ab5-7248-4ec7-8d5b-4b8b61cb3153 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-406694843" status: 202 len: 0 microversion: 2.1 time: 0.049018 Sep 12 23:58:28.864101 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 293/579] 10.222.0.26 () {58 vars in 1218 bytes} [Mon Sep 12 23:58:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-406694843 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 12 23:58:29.271050 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5167fc22-d0da-4ee1-94c5-106be6c769ab tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:29.272830 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5167fc22-d0da-4ee1-94c5-106be6c769ab tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: f1ff4faa-6a45-4d62-9e44-80dba7a947c0] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:29.290540 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5167fc22-d0da-4ee1-94c5-106be6c769ab tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:29.291345 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5167fc22-d0da-4ee1-94c5-106be6c769ab tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:29.291975 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5167fc22-d0da-4ee1-94c5-106be6c769ab tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:29.294083 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5167fc22-d0da-4ee1-94c5-106be6c769ab tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:29.295017 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5167fc22-d0da-4ee1-94c5-106be6c769ab tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:29.295855 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5167fc22-d0da-4ee1-94c5-106be6c769ab tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:29.364703 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5167fc22-d0da-4ee1-94c5-106be6c769ab tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:29.365817 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5167fc22-d0da-4ee1-94c5-106be6c769ab tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:29.366556 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5167fc22-d0da-4ee1-94c5-106be6c769ab tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:29.367340 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.objects.instance [None req-5167fc22-d0da-4ee1-94c5-106be6c769ab tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lazy-loading 'fault' on Instance uuid f1ff4faa-6a45-4d62-9e44-80dba7a947c0 {{(pid=126976) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 23:58:29.438766 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-5167fc22-d0da-4ee1-94c5-106be6c769ab tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:29.464905 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5167fc22-d0da-4ee1-94c5-106be6c769ab tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0" status: 200 len: 1330 microversion: 2.1 time: 0.202983 Sep 12 23:58:29.466787 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 287/580] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:58:29 2022] GET /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0 => generated 1330 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:58:30.496079 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7d0251d3-6991-4c57-89ca-663dfa090ec0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:30.496976 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7d0251d3-6991-4c57-89ca-663dfa090ec0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: f1ff4faa-6a45-4d62-9e44-80dba7a947c0] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:30.503824 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7d0251d3-6991-4c57-89ca-663dfa090ec0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:30.504557 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7d0251d3-6991-4c57-89ca-663dfa090ec0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:30.505218 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7d0251d3-6991-4c57-89ca-663dfa090ec0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:30.506229 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7d0251d3-6991-4c57-89ca-663dfa090ec0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:30.506823 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7d0251d3-6991-4c57-89ca-663dfa090ec0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:30.507539 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7d0251d3-6991-4c57-89ca-663dfa090ec0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:30.524084 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-7d0251d3-6991-4c57-89ca-663dfa090ec0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] HTTP exception thrown: Instance f1ff4faa-6a45-4d62-9e44-80dba7a947c0 could not be found. Sep 12 23:58:30.526386 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7d0251d3-6991-4c57-89ca-663dfa090ec0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Request method failure captured: Sep 12 23:58:30.526386 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: request: GET /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0 HTTP/1.1 Sep 12 23:58:30.526386 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept: application/json Sep 12 23:58:30.526386 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Sep 12 23:58:30.526386 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Connection: close Sep 12 23:58:30.526386 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Length: 0 Sep 12 23:58:30.526386 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Type: application/json Sep 12 23:58:30.526386 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Host: 10.222.0.26 Sep 12 23:58:30.526386 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Sep 12 23:58:30.526386 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Sep 12 23:58:30.526386 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjH8Z2hSl_dF3G_DVeQeMffC839mjKCX1ldHy7KYxwLbzxfI-Hnili9xft2wG7WgRYfuNYC0jIjSduHyiAWMPed8uo_fiAxdNKw8dFJEFK0lHOKo1_8VeXMUxxHgYF50XY0v_lkkNk_ejqmvpqtZKiNqfO8LXenu9zNmJy4upaAKztdpU Sep 12 23:58:30.526386 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Sep 12 23:58:30.526386 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Sep 12 23:58:30.526386 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Sep 12 23:58:30.526386 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Sep 12 23:58:30.526386 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Sep 12 23:58:30.526386 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Sep 12 23:58:30.526386 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Id: 6c681f1232de4a5fbfc728c230f80624 Sep 12 23:58:30.526386 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-AttachVolumeNegativeTest-1965954712 Sep 12 23:58:30.526386 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Role: member,reader Sep 12 23:58:30.526386 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Roles: member,reader Sep 12 23:58:30.528862 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6c681f1232de4a5fbfc728c230f80624"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6c681f1232de4a5fbfc728c230f80624"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6c681f1232de4a5fbfc728c230f80624"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6c681f1232de4a5fbfc728c230f80624"}]}] Sep 12 23:58:30.528862 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-AttachVolumeNegativeTest-1965954712 Sep 12 23:58:30.528862 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Id: 6c681f1232de4a5fbfc728c230f80624 Sep 12 23:58:30.528862 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1965954712 Sep 12 23:58:30.528862 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User: tempest-AttachVolumeNegativeTest-1965954712-project Sep 12 23:58:30.528862 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Sep 12 23:58:30.528862 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Sep 12 23:58:30.528862 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Id: a8cbfc74644f4d4594a70b833ad7002c Sep 12 23:58:30.528862 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-AttachVolumeNegativeTest-1965954712-project Sep 12 23:58:30.528862 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: method: > Sep 12 23:58:30.528862 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: exception: Instance f1ff4faa-6a45-4d62-9e44-80dba7a947c0 could not be found. Sep 12 23:58:30.528862 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: action_args: {'id': 'f1ff4faa-6a45-4d62-9e44-80dba7a947c0'} Sep 12 23:58:30.530352 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:58:30.530352 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:58:30.530352 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:58:30.530352 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:58:30.530352 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:58:30.530352 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:58:30.530352 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:58:30.530352 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:58:30.530352 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:58:30.530352 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:58:30.530352 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1ff4faa-6a45-4d62-9e44-80dba7a947c0 could not be found. Sep 12 23:58:30.530352 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:58:30.530352 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:58:30.530352 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:58:30.530352 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:58:30.530352 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:58:30.530352 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:58:30.530352 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:58:30.530352 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:58:30.530352 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:58:30.532922 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:58:30.532922 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 23:58:30.532922 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 23:58:30.532922 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:58:30.532922 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:58:30.532922 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:58:30.532922 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:58:30.532922 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1ff4faa-6a45-4d62-9e44-80dba7a947c0 could not be found. Sep 12 23:58:30.532922 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:58:30.532922 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:58:30.532922 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:58:30.532922 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:58:30.532922 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:58:30.532922 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:58:30.532922 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:58:30.532922 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:58:30.532922 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1ff4faa-6a45-4d62-9e44-80dba7a947c0 could not be found. Sep 12 23:58:30.532922 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:58:30.535083 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7d0251d3-6991-4c57-89ca-663dfa090ec0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Returning 404 to user: Instance f1ff4faa-6a45-4d62-9e44-80dba7a947c0 could not be found. {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:58:30.535083 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7d0251d3-6991-4c57-89ca-663dfa090ec0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0" status: 404 len: 111 microversion: 2.1 time: 0.041327 Sep 12 23:58:30.535083 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 294/581] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:58:30 2022] GET /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:58:30.540403 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3fed9770-9038-4ffc-9118-7e3dc7e9b755 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '.version_select at 0x7fed014a6940>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:30.563287 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3fed9770-9038-4ffc-9118-7e3dc7e9b755 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-220770329" status: 202 len: 0 microversion: 2.1 time: 0.027015 Sep 12 23:58:30.563853 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 288/582] 10.222.0.26 () {58 vars in 1218 bytes} [Mon Sep 12 23:58:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-220770329 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 12 23:58:31.360216 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-26da51c7-4962-4b52-bb46-418a9aa56f5a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Action: 'create', calling method: .version_select at 0x7fed0143a940>, body: {"keypair": {"name": "tempest-keypair-2038580038", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1Um+xTt5UEXUlz6BDObgUhbwfFR8Fp+6BBPnWIMoeq1h/1w5p0UUSseaUv4mlOm2G/VFqxiYQ8BFq7876+Dfe+a0d2PN4Y3XLGldwq1R9aeYHfrbBvlKz+GBWWTw37zA=="}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:58:31.376441 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-26da51c7-4962-4b52-bb46-418a9aa56f5a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Getting quotas for project 6c681f1232de4a5fbfc728c230f80624. Resources: {'key_pairs'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 23:58:31.380812 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-26da51c7-4962-4b52-bb46-418a9aa56f5a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Getting quotas for user a8cbfc74644f4d4594a70b833ad7002c and project 6c681f1232de4a5fbfc728c230f80624. Resources: {'key_pairs'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 23:58:31.405985 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-26da51c7-4962-4b52-bb46-418a9aa56f5a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050655 Sep 12 23:58:31.406606 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 295/583] 10.222.0.26 () {60 vars in 1159 bytes} [Mon Sep 12 23:58:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:58:31.782479 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1701f647-beee-49ff-86cb-07a7a2d6ae6a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:31.784085 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1701f647-beee-49ff-86cb-07a7a2d6ae6a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:31.792840 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1701f647-beee-49ff-86cb-07a7a2d6ae6a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:31.793335 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1701f647-beee-49ff-86cb-07a7a2d6ae6a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:31.793930 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1701f647-beee-49ff-86cb-07a7a2d6ae6a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:31.794658 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1701f647-beee-49ff-86cb-07a7a2d6ae6a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:31.795116 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1701f647-beee-49ff-86cb-07a7a2d6ae6a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:31.795581 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1701f647-beee-49ff-86cb-07a7a2d6ae6a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:31.830721 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1701f647-beee-49ff-86cb-07a7a2d6ae6a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f/ips" status: 200 len: 151 microversion: 2.20 time: 0.335673 Sep 12 23:58:31.831590 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 289/584] 10.222.0.26 () {60 vars in 1289 bytes} [Mon Sep 12 23:58:31 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f/ips => generated 151 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 23:58:32.281687 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-86d21aa3-55e2-42f1-abad-73ca055fd0b4 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:32.282359 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-86d21aa3-55e2-42f1-abad-73ca055fd0b4 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: f3ba81ef-4875-4ba4-94e0-c8275bfcf252] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:32.291253 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-86d21aa3-55e2-42f1-abad-73ca055fd0b4 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:32.292135 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-86d21aa3-55e2-42f1-abad-73ca055fd0b4 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:32.292618 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-86d21aa3-55e2-42f1-abad-73ca055fd0b4 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:32.293043 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-86d21aa3-55e2-42f1-abad-73ca055fd0b4 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:32.293496 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-86d21aa3-55e2-42f1-abad-73ca055fd0b4 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:32.293915 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-86d21aa3-55e2-42f1-abad-73ca055fd0b4 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:32.323070 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-86d21aa3-55e2-42f1-abad-73ca055fd0b4 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: f3ba81ef-4875-4ba4-94e0-c8275bfcf252] Going to try to terminate instance {{(pid=126975) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 23:58:32.352203 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:58:32.411556 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-86d21aa3-55e2-42f1-abad-73ca055fd0b4 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252" status: 204 len: 0 microversion: 2.1 time: 0.134367 Sep 12 23:58:32.412426 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 296/585] 10.222.0.26 () {58 vars in 1239 bytes} [Mon Sep 12 23:58:32 2022] DELETE /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 12 23:58:32.424877 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7b7b8bfc-87bd-45c7-bd49-7d76d44682b7 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:32.425736 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7b7b8bfc-87bd-45c7-bd49-7d76d44682b7 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: f3ba81ef-4875-4ba4-94e0-c8275bfcf252] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:32.434201 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7b7b8bfc-87bd-45c7-bd49-7d76d44682b7 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:32.435822 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7b7b8bfc-87bd-45c7-bd49-7d76d44682b7 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:32.436636 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7b7b8bfc-87bd-45c7-bd49-7d76d44682b7 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:32.437702 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7b7b8bfc-87bd-45c7-bd49-7d76d44682b7 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:32.438423 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7b7b8bfc-87bd-45c7-bd49-7d76d44682b7 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:32.438926 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7b7b8bfc-87bd-45c7-bd49-7d76d44682b7 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:32.761568 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7b7b8bfc-87bd-45c7-bd49-7d76d44682b7 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:32.776269 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7b7b8bfc-87bd-45c7-bd49-7d76d44682b7 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252" status: 200 len: 1507 microversion: 2.1 time: 0.355570 Sep 12 23:58:32.777030 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 290/586] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:58:32 2022] GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252 => generated 1507 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:58:33.218104 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f87d9555-b496-4704-a605-d89430c49085 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1296702448", "imageRef": "22a47167-5e04-441a-a504-d76d82afc776", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3c1b7b6d-23b0-4d33-9526-13eb374ddc8c"}], "security_groups": [{"name": "tempest-securitygroup--1927824989"}], "key_name": "tempest-keypair-2038580038", "user_data": "}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:58:33.391064 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.network.neutron [None req-f87d9555-b496-4704-a605-d89430c49085 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] validate_networks() for [('3c1b7b6d-23b0-4d33-9526-13eb374ddc8c', None, None, None, None, None)] {{(pid=126975) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 23:58:33.822680 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d1b645d1-5cbe-4010-b0f8-32876f6f993b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:33.824365 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d1b645d1-5cbe-4010-b0f8-32876f6f993b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: f3ba81ef-4875-4ba4-94e0-c8275bfcf252] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:33.835026 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d1b645d1-5cbe-4010-b0f8-32876f6f993b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:33.836015 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d1b645d1-5cbe-4010-b0f8-32876f6f993b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:33.836766 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d1b645d1-5cbe-4010-b0f8-32876f6f993b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:33.838203 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d1b645d1-5cbe-4010-b0f8-32876f6f993b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:33.838992 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d1b645d1-5cbe-4010-b0f8-32876f6f993b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:33.839757 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d1b645d1-5cbe-4010-b0f8-32876f6f993b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:34.052491 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-f87d9555-b496-4704-a605-d89430c49085 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Flavor limits 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 23:58:34.053036 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-f87d9555-b496-4704-a605-d89430c49085 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Image limits 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 23:58:34.053737 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-f87d9555-b496-4704-a605-d89430c49085 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Flavor pref 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 23:58:34.054176 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-f87d9555-b496-4704-a605-d89430c49085 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Image pref 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 23:58:34.054683 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-f87d9555-b496-4704-a605-d89430c49085 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 23:58:34.071528 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f87d9555-b496-4704-a605-d89430c49085 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:34.072171 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f87d9555-b496-4704-a605-d89430c49085 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:34.072793 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f87d9555-b496-4704-a605-d89430c49085 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:34.073868 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f87d9555-b496-4704-a605-d89430c49085 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:34.074447 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f87d9555-b496-4704-a605-d89430c49085 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:34.075079 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f87d9555-b496-4704-a605-d89430c49085 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:34.082302 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d1b645d1-5cbe-4010-b0f8-32876f6f993b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:34.092664 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d1b645d1-5cbe-4010-b0f8-32876f6f993b tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252" status: 200 len: 1507 microversion: 2.1 time: 0.278239 Sep 12 23:58:34.093513 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 291/587] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:58:33 2022] GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252 => generated 1507 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:58:34.098716 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-f87d9555-b496-4704-a605-d89430c49085 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Getting quotas for project 6c681f1232de4a5fbfc728c230f80624. Resources: {'instances', 'cores', 'ram'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 23:58:34.102851 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7762e3f5-4159-48ba-b645-c0c266795de2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:58:34.103965 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7762e3f5-4159-48ba-b645-c0c266795de2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:34.106153 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-f87d9555-b496-4704-a605-d89430c49085 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Getting quotas for user a8cbfc74644f4d4594a70b833ad7002c and project 6c681f1232de4a5fbfc728c230f80624. Resources: {'instances', 'cores', 'ram'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 23:58:34.116291 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7762e3f5-4159-48ba-b645-c0c266795de2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:34.117104 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7762e3f5-4159-48ba-b645-c0c266795de2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:34.117907 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7762e3f5-4159-48ba-b645-c0c266795de2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:34.119210 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7762e3f5-4159-48ba-b645-c0c266795de2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:34.120163 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7762e3f5-4159-48ba-b645-c0c266795de2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:34.120977 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7762e3f5-4159-48ba-b645-c0c266795de2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:34.124366 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f87d9555-b496-4704-a605-d89430c49085 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Going to run 1 instances... {{(pid=126975) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 23:58:34.124855 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:58:34.128593 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f87d9555-b496-4704-a605-d89430c49085 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='22a47167-5e04-441a-a504-d76d82afc776',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126975) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 23:58:34.153867 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.objects.instance [None req-7762e3f5-4159-48ba-b645-c0c266795de2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lazy-loading 'flavor' on Instance uuid 3088bc31-f3ff-476d-a0ad-9f10186b442f {{(pid=126976) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 23:58:34.194811 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f87d9555-b496-4704-a605-d89430c49085 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.981440 Sep 12 23:58:34.195818 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 297/588] 10.222.0.26 () {60 vars in 1147 bytes} [Mon Sep 12 23:58:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 983 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 12 23:58:34.209283 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9a585573-dc36-4fb2-9f03-66d9b15e9975 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:34.209894 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9a585573-dc36-4fb2-9f03-66d9b15e9975 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:34.285761 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9a585573-dc36-4fb2-9f03-66d9b15e9975 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:34.302396 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9a585573-dc36-4fb2-9f03-66d9b15e9975 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5" status: 200 len: 1242 microversion: 2.1 time: 0.097421 Sep 12 23:58:34.308217 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 298/589] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:58:34 2022] GET /compute/v2.1/servers/b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5 => generated 1242 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:58:34.417259 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7762e3f5-4159-48ba-b645-c0c266795de2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "POST /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f/action" status: 202 len: 0 microversion: 2.20 time: 0.322064 Sep 12 23:58:34.417927 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 292/590] 10.222.0.26 () {62 vars in 1319 bytes} [Mon Sep 12 23:58:34 2022] POST /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f/action => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 12 23:58:34.426867 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5f5f8abc-ec4d-4a44-a7df-c714723cf0ef tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:34.427670 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5f5f8abc-ec4d-4a44-a7df-c714723cf0ef tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:34.434339 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5f5f8abc-ec4d-4a44-a7df-c714723cf0ef tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:34.434819 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5f5f8abc-ec4d-4a44-a7df-c714723cf0ef tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:34.435277 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5f5f8abc-ec4d-4a44-a7df-c714723cf0ef tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:34.436148 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5f5f8abc-ec4d-4a44-a7df-c714723cf0ef tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:34.436599 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5f5f8abc-ec4d-4a44-a7df-c714723cf0ef tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:34.437024 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5f5f8abc-ec4d-4a44-a7df-c714723cf0ef tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:34.596426 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5f5f8abc-ec4d-4a44-a7df-c714723cf0ef tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:34.607590 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5f5f8abc-ec4d-4a44-a7df-c714723cf0ef tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:34.609474 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5f5f8abc-ec4d-4a44-a7df-c714723cf0ef tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:34.611112 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5f5f8abc-ec4d-4a44-a7df-c714723cf0ef tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1723 microversion: 2.20 time: 0.188415 Sep 12 23:58:34.611803 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 299/591] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:58:34 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:58:35.133678 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-269d958e-4cb7-4b8a-a85c-dc8572e2f83c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:35.136315 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-269d958e-4cb7-4b8a-a85c-dc8572e2f83c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: f3ba81ef-4875-4ba4-94e0-c8275bfcf252] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:35.150746 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-269d958e-4cb7-4b8a-a85c-dc8572e2f83c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:35.154559 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-269d958e-4cb7-4b8a-a85c-dc8572e2f83c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:35.156233 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-269d958e-4cb7-4b8a-a85c-dc8572e2f83c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:35.157857 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-269d958e-4cb7-4b8a-a85c-dc8572e2f83c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:35.158598 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-269d958e-4cb7-4b8a-a85c-dc8572e2f83c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:35.159420 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-269d958e-4cb7-4b8a-a85c-dc8572e2f83c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:35.341299 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-831a90c7-0f0a-478e-a579-a01a4e99f1c6 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:35.342455 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-831a90c7-0f0a-478e-a579-a01a4e99f1c6 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:35.354381 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-831a90c7-0f0a-478e-a579-a01a4e99f1c6 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:35.355258 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-831a90c7-0f0a-478e-a579-a01a4e99f1c6 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:35.356116 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-831a90c7-0f0a-478e-a579-a01a4e99f1c6 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:35.357277 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-831a90c7-0f0a-478e-a579-a01a4e99f1c6 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:35.358045 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-831a90c7-0f0a-478e-a579-a01a4e99f1c6 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:35.358676 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-831a90c7-0f0a-478e-a579-a01a4e99f1c6 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:35.421440 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-269d958e-4cb7-4b8a-a85c-dc8572e2f83c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:35.435386 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-269d958e-4cb7-4b8a-a85c-dc8572e2f83c tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252" status: 200 len: 1507 microversion: 2.1 time: 0.307773 Sep 12 23:58:35.436321 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 293/592] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:58:35 2022] GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252 => generated 1507 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:58:35.475789 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-831a90c7-0f0a-478e-a579-a01a4e99f1c6 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:35.489988 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-831a90c7-0f0a-478e-a579-a01a4e99f1c6 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5" status: 200 len: 1294 microversion: 2.1 time: 0.156920 Sep 12 23:58:35.491189 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 300/593] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:58:35 2022] GET /compute/v2.1/servers/b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5 => generated 1294 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:58:35.636679 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-a2492254-a961-4dfc-99c6-55571141425c req-dc51083a-a27c-417c-a200-06bad7cb7573 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3ba81ef-4875-4ba4-94e0-c8275bfcf252", "name": "network-vif-deleted", "tag": "b826088f-8d82-4b72-a304-bc22a8977946"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:58:35.643284 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-03980c4d-28fa-4257-b189-c9769119bd6a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:35.644238 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-03980c4d-28fa-4257-b189-c9769119bd6a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:35.648323 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-a2492254-a961-4dfc-99c6-55571141425c req-dc51083a-a27c-417c-a200-06bad7cb7573 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:35.649613 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-a2492254-a961-4dfc-99c6-55571141425c req-dc51083a-a27c-417c-a200-06bad7cb7573 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:35.650063 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-a2492254-a961-4dfc-99c6-55571141425c req-dc51083a-a27c-417c-a200-06bad7cb7573 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:35.651892 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-03980c4d-28fa-4257-b189-c9769119bd6a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:35.652643 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-03980c4d-28fa-4257-b189-c9769119bd6a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:35.653120 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-03980c4d-28fa-4257-b189-c9769119bd6a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:35.653970 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-03980c4d-28fa-4257-b189-c9769119bd6a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:35.654762 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-03980c4d-28fa-4257-b189-c9769119bd6a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:35.655507 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-03980c4d-28fa-4257-b189-c9769119bd6a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:35.662514 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-a2492254-a961-4dfc-99c6-55571141425c req-dc51083a-a27c-417c-a200-06bad7cb7573 service nova] Creating event network-vif-deleted:b826088f-8d82-4b72-a304-bc22a8977946 for instance f3ba81ef-4875-4ba4-94e0-c8275bfcf252 on hv-cinder-82002 Sep 12 23:58:35.667834 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-a2492254-a961-4dfc-99c6-55571141425c req-dc51083a-a27c-417c-a200-06bad7cb7573 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034921 Sep 12 23:58:35.668449 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 294/594] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:58:35.841098 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-03980c4d-28fa-4257-b189-c9769119bd6a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:35.850806 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-03980c4d-28fa-4257-b189-c9769119bd6a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:35.858418 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-03980c4d-28fa-4257-b189-c9769119bd6a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:35.871814 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-03980c4d-28fa-4257-b189-c9769119bd6a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1723 microversion: 2.20 time: 0.220282 Sep 12 23:58:35.872603 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 301/595] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:58:35 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:58:36.462299 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-48ff19bf-b64a-4b23-9c23-7febe812bea2 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:36.463058 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-48ff19bf-b64a-4b23-9c23-7febe812bea2 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: f3ba81ef-4875-4ba4-94e0-c8275bfcf252] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:36.472490 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-48ff19bf-b64a-4b23-9c23-7febe812bea2 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:36.472990 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-48ff19bf-b64a-4b23-9c23-7febe812bea2 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:36.473428 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-48ff19bf-b64a-4b23-9c23-7febe812bea2 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:36.474148 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-48ff19bf-b64a-4b23-9c23-7febe812bea2 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:36.474793 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-48ff19bf-b64a-4b23-9c23-7febe812bea2 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:36.475244 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-48ff19bf-b64a-4b23-9c23-7febe812bea2 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:36.511848 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-48ff19bf-b64a-4b23-9c23-7febe812bea2 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:36.512336 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-48ff19bf-b64a-4b23-9c23-7febe812bea2 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:36.512950 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-48ff19bf-b64a-4b23-9c23-7febe812bea2 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:36.514002 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.objects.instance [None req-48ff19bf-b64a-4b23-9c23-7febe812bea2 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lazy-loading 'fault' on Instance uuid f3ba81ef-4875-4ba4-94e0-c8275bfcf252 {{(pid=126976) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 23:58:36.516216 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2df33ff1-918a-43bb-a185-d28d14cbc952 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:36.517307 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2df33ff1-918a-43bb-a185-d28d14cbc952 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:36.527503 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2df33ff1-918a-43bb-a185-d28d14cbc952 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:36.528289 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2df33ff1-918a-43bb-a185-d28d14cbc952 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:36.528718 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2df33ff1-918a-43bb-a185-d28d14cbc952 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:36.529421 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2df33ff1-918a-43bb-a185-d28d14cbc952 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:36.530304 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2df33ff1-918a-43bb-a185-d28d14cbc952 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:36.530619 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2df33ff1-918a-43bb-a185-d28d14cbc952 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:36.567845 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-48ff19bf-b64a-4b23-9c23-7febe812bea2 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:36.575707 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-48ff19bf-b64a-4b23-9c23-7febe812bea2 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252" status: 200 len: 1311 microversion: 2.1 time: 0.119109 Sep 12 23:58:36.576941 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 295/596] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:58:36 2022] GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252 => generated 1311 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:58:36.619741 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2df33ff1-918a-43bb-a185-d28d14cbc952 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:36.629185 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2df33ff1-918a-43bb-a185-d28d14cbc952 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5" status: 200 len: 1300 microversion: 2.1 time: 0.117050 Sep 12 23:58:36.629783 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 302/597] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:58:36 2022] GET /compute/v2.1/servers/b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5 => generated 1300 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:58:36.900145 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-01d98d59-62dd-4d6a-bbb0-f8735d1816b6 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:36.900820 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-01d98d59-62dd-4d6a-bbb0-f8735d1816b6 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:36.908026 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-01d98d59-62dd-4d6a-bbb0-f8735d1816b6 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:36.908513 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-01d98d59-62dd-4d6a-bbb0-f8735d1816b6 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:36.908935 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-01d98d59-62dd-4d6a-bbb0-f8735d1816b6 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:36.909667 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-01d98d59-62dd-4d6a-bbb0-f8735d1816b6 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:36.910122 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-01d98d59-62dd-4d6a-bbb0-f8735d1816b6 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:36.910545 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-01d98d59-62dd-4d6a-bbb0-f8735d1816b6 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:37.147564 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-01d98d59-62dd-4d6a-bbb0-f8735d1816b6 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:37.156510 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-01d98d59-62dd-4d6a-bbb0-f8735d1816b6 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:37.158243 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-01d98d59-62dd-4d6a-bbb0-f8735d1816b6 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:37.159614 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-01d98d59-62dd-4d6a-bbb0-f8735d1816b6 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1723 microversion: 2.20 time: 0.265023 Sep 12 23:58:37.175250 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 296/598] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:58:36 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1723 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:58:37.599943 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1f79c66f-6876-4072-ae99-54c551bd77f4 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:37.600584 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1f79c66f-6876-4072-ae99-54c551bd77f4 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: f3ba81ef-4875-4ba4-94e0-c8275bfcf252] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:37.608208 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1f79c66f-6876-4072-ae99-54c551bd77f4 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:37.608724 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1f79c66f-6876-4072-ae99-54c551bd77f4 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:37.609154 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1f79c66f-6876-4072-ae99-54c551bd77f4 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:37.609868 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1f79c66f-6876-4072-ae99-54c551bd77f4 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:37.610314 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1f79c66f-6876-4072-ae99-54c551bd77f4 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:37.611085 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1f79c66f-6876-4072-ae99-54c551bd77f4 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:37.626720 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-1f79c66f-6876-4072-ae99-54c551bd77f4 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] HTTP exception thrown: Instance f3ba81ef-4875-4ba4-94e0-c8275bfcf252 could not be found. Sep 12 23:58:37.628908 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1f79c66f-6876-4072-ae99-54c551bd77f4 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Request method failure captured: Sep 12 23:58:37.628908 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: request: GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252 HTTP/1.1 Sep 12 23:58:37.628908 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept: application/json Sep 12 23:58:37.628908 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Sep 12 23:58:37.628908 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Connection: close Sep 12 23:58:37.628908 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Length: 0 Sep 12 23:58:37.628908 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Type: application/json Sep 12 23:58:37.628908 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Host: 10.222.0.26 Sep 12 23:58:37.628908 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Sep 12 23:58:37.628908 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Sep 12 23:58:37.628908 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjH8ZuStW1XXoPQe5y95eOpKYZF0F7YBvJw_27e2kYLBySngK1oyC8cbK16WrSBBy5I-zldm72baODkX7E0kbSH3YQJRovD2YiBAj_9m-miREAelhxMrO-4StKyBWO2wiypQKnAsHCgsduOcFVztxSrPSWmh7ZuLOXLc3LDIycAkgHl0E Sep 12 23:58:37.628908 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Sep 12 23:58:37.628908 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Sep 12 23:58:37.628908 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Sep 12 23:58:37.628908 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Sep 12 23:58:37.628908 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Sep 12 23:58:37.628908 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Sep 12 23:58:37.628908 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Id: 6c458cf41ded4113a09fb07e10d81d39 Sep 12 23:58:37.628908 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2096714212 Sep 12 23:58:37.628908 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Role: member,reader Sep 12 23:58:37.628908 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Roles: member,reader Sep 12 23:58:37.630425 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6c458cf41ded4113a09fb07e10d81d39"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6c458cf41ded4113a09fb07e10d81d39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6c458cf41ded4113a09fb07e10d81d39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6c458cf41ded4113a09fb07e10d81d39"}]}] Sep 12 23:58:37.630425 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2096714212 Sep 12 23:58:37.630425 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Id: 6c458cf41ded4113a09fb07e10d81d39 Sep 12 23:58:37.630425 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2096714212 Sep 12 23:58:37.630425 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User: tempest-ServerRescueNegativeTestJSON-2096714212-project Sep 12 23:58:37.630425 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Sep 12 23:58:37.630425 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Sep 12 23:58:37.630425 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Id: 76eb39c2010e43aaa0a01caaea3a38b9 Sep 12 23:58:37.630425 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2096714212-project Sep 12 23:58:37.630425 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: method: > Sep 12 23:58:37.630425 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: exception: Instance f3ba81ef-4875-4ba4-94e0-c8275bfcf252 could not be found. Sep 12 23:58:37.630425 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: action_args: {'id': 'f3ba81ef-4875-4ba4-94e0-c8275bfcf252'} Sep 12 23:58:37.631266 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:58:37.631266 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:58:37.631266 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:58:37.631266 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:58:37.631266 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:58:37.631266 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:58:37.631266 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:58:37.631266 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:58:37.631266 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:58:37.631266 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:58:37.631266 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3ba81ef-4875-4ba4-94e0-c8275bfcf252 could not be found. Sep 12 23:58:37.631266 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:58:37.631266 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:58:37.631266 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:58:37.631266 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:58:37.631266 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:58:37.631266 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:58:37.631266 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:58:37.631266 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:58:37.631266 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:58:37.632569 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:58:37.632569 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 23:58:37.632569 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 23:58:37.632569 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:58:37.632569 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:58:37.632569 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:58:37.632569 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:58:37.632569 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3ba81ef-4875-4ba4-94e0-c8275bfcf252 could not be found. Sep 12 23:58:37.632569 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:58:37.632569 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:58:37.632569 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:58:37.632569 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:58:37.632569 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:58:37.632569 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:58:37.632569 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:58:37.632569 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:58:37.632569 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3ba81ef-4875-4ba4-94e0-c8275bfcf252 could not be found. Sep 12 23:58:37.632569 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:58:37.633632 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1f79c66f-6876-4072-ae99-54c551bd77f4 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Returning 404 to user: Instance f3ba81ef-4875-4ba4-94e0-c8275bfcf252 could not be found. {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:58:37.633632 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1f79c66f-6876-4072-ae99-54c551bd77f4 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252" status: 404 len: 111 microversion: 2.1 time: 0.034413 Sep 12 23:58:37.633632 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 303/599] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:58:37 2022] GET /compute/v2.1/servers/f3ba81ef-4875-4ba4-94e0-c8275bfcf252 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 12 23:58:37.640175 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-dea647f2-fd7b-4f8b-abe6-19a68321aa08 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:37.640683 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-dea647f2-fd7b-4f8b-abe6-19a68321aa08 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 695586a7-2b4d-477b-ab83-9e74f5f7078a] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:37.650065 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dea647f2-fd7b-4f8b-abe6-19a68321aa08 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:37.650470 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dea647f2-fd7b-4f8b-abe6-19a68321aa08 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:37.650890 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dea647f2-fd7b-4f8b-abe6-19a68321aa08 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:37.651876 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dea647f2-fd7b-4f8b-abe6-19a68321aa08 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:37.652080 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dea647f2-fd7b-4f8b-abe6-19a68321aa08 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:37.652498 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dea647f2-fd7b-4f8b-abe6-19a68321aa08 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:37.654374 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9d4faf37-0321-43c3-b2fa-aca16853ccba tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:37.656055 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9d4faf37-0321-43c3-b2fa-aca16853ccba tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:37.666104 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9d4faf37-0321-43c3-b2fa-aca16853ccba tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:37.666648 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9d4faf37-0321-43c3-b2fa-aca16853ccba tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:37.667081 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9d4faf37-0321-43c3-b2fa-aca16853ccba tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:37.667847 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9d4faf37-0321-43c3-b2fa-aca16853ccba tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:37.668393 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9d4faf37-0321-43c3-b2fa-aca16853ccba tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:37.668873 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9d4faf37-0321-43c3-b2fa-aca16853ccba tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:37.685041 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-dea647f2-fd7b-4f8b-abe6-19a68321aa08 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 695586a7-2b4d-477b-ab83-9e74f5f7078a] Going to try to terminate instance {{(pid=126976) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 23:58:37.786365 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-dea647f2-fd7b-4f8b-abe6-19a68321aa08 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "DELETE /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a" status: 204 len: 0 microversion: 2.1 time: 0.150624 Sep 12 23:58:37.787292 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 297/600] 10.222.0.26 () {58 vars in 1239 bytes} [Mon Sep 12 23:58:37 2022] DELETE /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 12 23:58:37.792688 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-52c6b462-2c1d-499c-a5bb-70cc639a1495 req-8e2f1b8c-77f0-426f-aca0-775c693556b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5", "tag": "3518a015-4b9d-49ce-83c7-2bc6c147a0ba"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:58:37.805613 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-52c6b462-2c1d-499c-a5bb-70cc639a1495 req-8e2f1b8c-77f0-426f-aca0-775c693556b7 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:37.806082 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-52c6b462-2c1d-499c-a5bb-70cc639a1495 req-8e2f1b8c-77f0-426f-aca0-775c693556b7 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:37.806465 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-52c6b462-2c1d-499c-a5bb-70cc639a1495 req-8e2f1b8c-77f0-426f-aca0-775c693556b7 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:37.819830 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-52c6b462-2c1d-499c-a5bb-70cc639a1495 req-8e2f1b8c-77f0-426f-aca0-775c693556b7 service nova] Creating event network-changed:3518a015-4b9d-49ce-83c7-2bc6c147a0ba for instance b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5 on hv-cinder-82002 Sep 12 23:58:37.824876 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-52c6b462-2c1d-499c-a5bb-70cc639a1495 req-8e2f1b8c-77f0-426f-aca0-775c693556b7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036458 Sep 12 23:58:37.825482 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 298/601] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:58:37.830545 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ed5a4eb9-07f0-4172-b3b7-2a63ef424a71 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:37.831264 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ed5a4eb9-07f0-4172-b3b7-2a63ef424a71 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 695586a7-2b4d-477b-ab83-9e74f5f7078a] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:37.838730 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ed5a4eb9-07f0-4172-b3b7-2a63ef424a71 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:37.839251 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ed5a4eb9-07f0-4172-b3b7-2a63ef424a71 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:37.839675 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ed5a4eb9-07f0-4172-b3b7-2a63ef424a71 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:37.840482 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ed5a4eb9-07f0-4172-b3b7-2a63ef424a71 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:37.840817 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ed5a4eb9-07f0-4172-b3b7-2a63ef424a71 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:37.841235 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ed5a4eb9-07f0-4172-b3b7-2a63ef424a71 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:37.888910 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9d4faf37-0321-43c3-b2fa-aca16853ccba tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:37.897569 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9d4faf37-0321-43c3-b2fa-aca16853ccba tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5" status: 200 len: 1368 microversion: 2.1 time: 0.248089 Sep 12 23:58:37.902488 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 304/602] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:58:37 2022] GET /compute/v2.1/servers/b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5 => generated 1368 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:58:37.982443 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ed5a4eb9-07f0-4172-b3b7-2a63ef424a71 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:37.994359 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ed5a4eb9-07f0-4172-b3b7-2a63ef424a71 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a" status: 200 len: 1523 microversion: 2.1 time: 0.167472 Sep 12 23:58:37.995141 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 299/603] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:58:37 2022] GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:58:38.186806 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8517cc5b-b74a-4812-96cd-09e086a00f76 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:38.187409 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8517cc5b-b74a-4812-96cd-09e086a00f76 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:38.189554 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:58:38.195180 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8517cc5b-b74a-4812-96cd-09e086a00f76 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:38.195696 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8517cc5b-b74a-4812-96cd-09e086a00f76 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:38.197317 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8517cc5b-b74a-4812-96cd-09e086a00f76 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:38.197317 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8517cc5b-b74a-4812-96cd-09e086a00f76 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:38.197317 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8517cc5b-b74a-4812-96cd-09e086a00f76 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:38.197717 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8517cc5b-b74a-4812-96cd-09e086a00f76 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:38.329789 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8517cc5b-b74a-4812-96cd-09e086a00f76 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:38.338634 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8517cc5b-b74a-4812-96cd-09e086a00f76 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:38.340100 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8517cc5b-b74a-4812-96cd-09e086a00f76 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:38.341264 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8517cc5b-b74a-4812-96cd-09e086a00f76 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1723 microversion: 2.20 time: 0.158579 Sep 12 23:58:38.341825 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 305/604] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:58:38 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:58:38.921780 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8863c635-a8ed-491f-9194-37b7d2224ad8 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:38.922466 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-8863c635-a8ed-491f-9194-37b7d2224ad8 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:38.929973 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8863c635-a8ed-491f-9194-37b7d2224ad8 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:38.930523 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8863c635-a8ed-491f-9194-37b7d2224ad8 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:38.931305 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8863c635-a8ed-491f-9194-37b7d2224ad8 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:38.932125 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8863c635-a8ed-491f-9194-37b7d2224ad8 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:38.933547 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8863c635-a8ed-491f-9194-37b7d2224ad8 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:38.933547 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8863c635-a8ed-491f-9194-37b7d2224ad8 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:39.018041 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-bf18c5d8-0bcd-4ff8-bc7b-d6ac728fc8a6 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:39.018917 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-bf18c5d8-0bcd-4ff8-bc7b-d6ac728fc8a6 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 695586a7-2b4d-477b-ab83-9e74f5f7078a] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:39.027371 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf18c5d8-0bcd-4ff8-bc7b-d6ac728fc8a6 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:39.027977 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf18c5d8-0bcd-4ff8-bc7b-d6ac728fc8a6 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:39.028417 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf18c5d8-0bcd-4ff8-bc7b-d6ac728fc8a6 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:39.029108 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf18c5d8-0bcd-4ff8-bc7b-d6ac728fc8a6 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:39.029561 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf18c5d8-0bcd-4ff8-bc7b-d6ac728fc8a6 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:39.029979 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf18c5d8-0bcd-4ff8-bc7b-d6ac728fc8a6 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:39.133326 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8863c635-a8ed-491f-9194-37b7d2224ad8 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:39.153285 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-8863c635-a8ed-491f-9194-37b7d2224ad8 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5" status: 200 len: 1368 microversion: 2.1 time: 0.235891 Sep 12 23:58:39.154392 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 300/605] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:58:38 2022] GET /compute/v2.1/servers/b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5 => generated 1368 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:58:39.211372 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-bf18c5d8-0bcd-4ff8-bc7b-d6ac728fc8a6 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:39.220119 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-bf18c5d8-0bcd-4ff8-bc7b-d6ac728fc8a6 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a" status: 200 len: 1523 microversion: 2.1 time: 0.206198 Sep 12 23:58:39.220708 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 306/606] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:58:39 2022] GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a => generated 1523 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:58:39.366577 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-454cd852-d149-422e-b638-3961e777f54e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:39.367253 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-454cd852-d149-422e-b638-3961e777f54e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:39.373585 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-454cd852-d149-422e-b638-3961e777f54e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:39.374097 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-454cd852-d149-422e-b638-3961e777f54e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:39.374534 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-454cd852-d149-422e-b638-3961e777f54e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:39.375261 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-454cd852-d149-422e-b638-3961e777f54e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:39.375719 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-454cd852-d149-422e-b638-3961e777f54e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:39.376139 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-454cd852-d149-422e-b638-3961e777f54e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:39.519100 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-454cd852-d149-422e-b638-3961e777f54e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:39.530448 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-454cd852-d149-422e-b638-3961e777f54e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:39.532011 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-454cd852-d149-422e-b638-3961e777f54e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:39.533214 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-454cd852-d149-422e-b638-3961e777f54e tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1723 microversion: 2.20 time: 0.170728 Sep 12 23:58:39.533868 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 301/607] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:58:39 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:58:40.177600 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a57358ee-0f5e-473d-98fa-de68ccae149f tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:40.178269 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a57358ee-0f5e-473d-98fa-de68ccae149f tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:40.185202 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a57358ee-0f5e-473d-98fa-de68ccae149f tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:40.185702 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a57358ee-0f5e-473d-98fa-de68ccae149f tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:40.186137 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a57358ee-0f5e-473d-98fa-de68ccae149f tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:40.186854 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a57358ee-0f5e-473d-98fa-de68ccae149f tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:40.187351 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a57358ee-0f5e-473d-98fa-de68ccae149f tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:40.187779 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a57358ee-0f5e-473d-98fa-de68ccae149f tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:40.246567 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c2419bdf-6452-4abf-a03d-e3c09b995ef6 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:40.247715 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c2419bdf-6452-4abf-a03d-e3c09b995ef6 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 695586a7-2b4d-477b-ab83-9e74f5f7078a] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:40.258293 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c2419bdf-6452-4abf-a03d-e3c09b995ef6 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:40.259154 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c2419bdf-6452-4abf-a03d-e3c09b995ef6 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:40.259792 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c2419bdf-6452-4abf-a03d-e3c09b995ef6 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:40.260805 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c2419bdf-6452-4abf-a03d-e3c09b995ef6 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:40.261526 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c2419bdf-6452-4abf-a03d-e3c09b995ef6 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:40.262114 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c2419bdf-6452-4abf-a03d-e3c09b995ef6 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:40.377342 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a57358ee-0f5e-473d-98fa-de68ccae149f tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:40.386725 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a57358ee-0f5e-473d-98fa-de68ccae149f tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5" status: 200 len: 1368 microversion: 2.1 time: 0.213141 Sep 12 23:58:40.387380 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 307/608] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:58:40 2022] GET /compute/v2.1/servers/b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5 => generated 1368 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:58:40.430397 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c2419bdf-6452-4abf-a03d-e3c09b995ef6 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:40.439208 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c2419bdf-6452-4abf-a03d-e3c09b995ef6 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a" status: 200 len: 1523 microversion: 2.1 time: 0.198869 Sep 12 23:58:40.439842 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 302/609] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:58:40 2022] GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a => generated 1523 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:58:40.560192 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-670144da-ea67-4072-a730-6cbd0585e4a5 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:40.560825 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-670144da-ea67-4072-a730-6cbd0585e4a5 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:40.567643 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-670144da-ea67-4072-a730-6cbd0585e4a5 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:40.568134 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-670144da-ea67-4072-a730-6cbd0585e4a5 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:40.568557 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-670144da-ea67-4072-a730-6cbd0585e4a5 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:40.569256 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-670144da-ea67-4072-a730-6cbd0585e4a5 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:40.569713 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-670144da-ea67-4072-a730-6cbd0585e4a5 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:40.570131 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-670144da-ea67-4072-a730-6cbd0585e4a5 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:40.712287 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-670144da-ea67-4072-a730-6cbd0585e4a5 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:40.721484 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-670144da-ea67-4072-a730-6cbd0585e4a5 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:40.723104 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-670144da-ea67-4072-a730-6cbd0585e4a5 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:40.724352 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-670144da-ea67-4072-a730-6cbd0585e4a5 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1723 microversion: 2.20 time: 0.168236 Sep 12 23:58:40.725046 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 308/610] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:58:40 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:58:41.411382 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e928173b-0ded-4f28-9f0c-48ea0de3cdd0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:41.412057 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e928173b-0ded-4f28-9f0c-48ea0de3cdd0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:41.419325 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e928173b-0ded-4f28-9f0c-48ea0de3cdd0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:41.419857 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e928173b-0ded-4f28-9f0c-48ea0de3cdd0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:41.420298 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e928173b-0ded-4f28-9f0c-48ea0de3cdd0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:41.421050 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e928173b-0ded-4f28-9f0c-48ea0de3cdd0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:41.421512 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e928173b-0ded-4f28-9f0c-48ea0de3cdd0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:41.421931 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e928173b-0ded-4f28-9f0c-48ea0de3cdd0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:41.465850 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3de5a2d7-83dd-4e98-b5b6-a1ab48c282aa tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:41.467045 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3de5a2d7-83dd-4e98-b5b6-a1ab48c282aa tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 695586a7-2b4d-477b-ab83-9e74f5f7078a] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:41.475429 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3de5a2d7-83dd-4e98-b5b6-a1ab48c282aa tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:41.475926 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3de5a2d7-83dd-4e98-b5b6-a1ab48c282aa tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:41.476364 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3de5a2d7-83dd-4e98-b5b6-a1ab48c282aa tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:41.477100 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3de5a2d7-83dd-4e98-b5b6-a1ab48c282aa tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:41.477537 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3de5a2d7-83dd-4e98-b5b6-a1ab48c282aa tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:41.477959 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3de5a2d7-83dd-4e98-b5b6-a1ab48c282aa tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:41.628632 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e928173b-0ded-4f28-9f0c-48ea0de3cdd0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:41.637054 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e928173b-0ded-4f28-9f0c-48ea0de3cdd0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5" status: 200 len: 1368 microversion: 2.1 time: 0.229575 Sep 12 23:58:41.637664 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 303/611] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:58:41 2022] GET /compute/v2.1/servers/b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5 => generated 1368 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:58:41.662731 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3de5a2d7-83dd-4e98-b5b6-a1ab48c282aa tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:41.671019 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3de5a2d7-83dd-4e98-b5b6-a1ab48c282aa tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a" status: 200 len: 1523 microversion: 2.1 time: 0.212199 Sep 12 23:58:41.671735 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 309/612] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:58:41 2022] GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a => generated 1523 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:58:41.750142 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1bb622c9-e91a-4f7e-adaf-c4b344d67caa tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:41.750782 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1bb622c9-e91a-4f7e-adaf-c4b344d67caa tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:41.757417 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1bb622c9-e91a-4f7e-adaf-c4b344d67caa tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:41.757890 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1bb622c9-e91a-4f7e-adaf-c4b344d67caa tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:41.758320 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1bb622c9-e91a-4f7e-adaf-c4b344d67caa tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:41.759007 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1bb622c9-e91a-4f7e-adaf-c4b344d67caa tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:41.759486 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1bb622c9-e91a-4f7e-adaf-c4b344d67caa tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:41.759892 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1bb622c9-e91a-4f7e-adaf-c4b344d67caa tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:41.903830 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-1bb622c9-e91a-4f7e-adaf-c4b344d67caa tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:41.914223 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-1bb622c9-e91a-4f7e-adaf-c4b344d67caa tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:41.916090 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-1bb622c9-e91a-4f7e-adaf-c4b344d67caa tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:41.917277 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1bb622c9-e91a-4f7e-adaf-c4b344d67caa tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1723 microversion: 2.20 time: 0.171210 Sep 12 23:58:41.917848 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 304/613] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:58:41 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 23:58:42.662284 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a266f38b-cf75-434e-aed8-e79e6bc1a984 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:42.663156 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a266f38b-cf75-434e-aed8-e79e6bc1a984 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:42.673852 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a266f38b-cf75-434e-aed8-e79e6bc1a984 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:42.675759 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a266f38b-cf75-434e-aed8-e79e6bc1a984 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:42.676616 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a266f38b-cf75-434e-aed8-e79e6bc1a984 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:42.678016 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a266f38b-cf75-434e-aed8-e79e6bc1a984 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:42.678988 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a266f38b-cf75-434e-aed8-e79e6bc1a984 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:42.680144 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a266f38b-cf75-434e-aed8-e79e6bc1a984 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:42.703509 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-84974bba-f240-4610-85ea-d514b0d44a03 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:42.704715 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-84974bba-f240-4610-85ea-d514b0d44a03 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 695586a7-2b4d-477b-ab83-9e74f5f7078a] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:42.714800 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-84974bba-f240-4610-85ea-d514b0d44a03 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:42.715349 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-84974bba-f240-4610-85ea-d514b0d44a03 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:42.715820 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-84974bba-f240-4610-85ea-d514b0d44a03 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:42.716704 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-84974bba-f240-4610-85ea-d514b0d44a03 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:42.717199 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-84974bba-f240-4610-85ea-d514b0d44a03 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:42.717989 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-84974bba-f240-4610-85ea-d514b0d44a03 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:43.050072 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a266f38b-cf75-434e-aed8-e79e6bc1a984 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:43.062878 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a266f38b-cf75-434e-aed8-e79e6bc1a984 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5" status: 200 len: 1368 microversion: 2.1 time: 0.404885 Sep 12 23:58:43.079625 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 310/614] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:58:42 2022] GET /compute/v2.1/servers/b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5 => generated 1368 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:58:43.085013 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ef2e685d-c0bc-4d55-9dc2-00c443b1fb81 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:43.085651 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ef2e685d-c0bc-4d55-9dc2-00c443b1fb81 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:43.092457 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ef2e685d-c0bc-4d55-9dc2-00c443b1fb81 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:43.092960 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ef2e685d-c0bc-4d55-9dc2-00c443b1fb81 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:43.093418 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ef2e685d-c0bc-4d55-9dc2-00c443b1fb81 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:43.094136 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ef2e685d-c0bc-4d55-9dc2-00c443b1fb81 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:43.094603 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ef2e685d-c0bc-4d55-9dc2-00c443b1fb81 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:43.095030 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ef2e685d-c0bc-4d55-9dc2-00c443b1fb81 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:43.147370 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-84974bba-f240-4610-85ea-d514b0d44a03 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:43.157140 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-84974bba-f240-4610-85ea-d514b0d44a03 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a" status: 200 len: 1523 microversion: 2.1 time: 0.463071 Sep 12 23:58:43.158142 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 305/615] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:58:42 2022] GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a => generated 1523 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:58:43.409563 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ef2e685d-c0bc-4d55-9dc2-00c443b1fb81 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:43.425695 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ef2e685d-c0bc-4d55-9dc2-00c443b1fb81 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:43.428914 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ef2e685d-c0bc-4d55-9dc2-00c443b1fb81 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:43.431931 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ef2e685d-c0bc-4d55-9dc2-00c443b1fb81 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1723 microversion: 2.20 time: 0.350796 Sep 12 23:58:43.432991 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 311/616] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:58:43 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1723 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:58:43.670432 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-1b4f0c20-11ca-4320-ab97-3b3aa91f9e20 req-7d0e68be-ad5d-4bab-a393-6dd6f5a09b96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "695586a7-2b4d-477b-ab83-9e74f5f7078a", "name": "network-vif-deleted", "tag": "c822ad88-7a3d-489a-9cdd-11e5745240c4"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:58:43.698967 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-1b4f0c20-11ca-4320-ab97-3b3aa91f9e20 req-7d0e68be-ad5d-4bab-a393-6dd6f5a09b96 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:43.699471 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-1b4f0c20-11ca-4320-ab97-3b3aa91f9e20 req-7d0e68be-ad5d-4bab-a393-6dd6f5a09b96 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:43.702380 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-1b4f0c20-11ca-4320-ab97-3b3aa91f9e20 req-7d0e68be-ad5d-4bab-a393-6dd6f5a09b96 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:43.707068 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:58:43.722102 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-1b4f0c20-11ca-4320-ab97-3b3aa91f9e20 req-7d0e68be-ad5d-4bab-a393-6dd6f5a09b96 service nova] Creating event network-vif-deleted:c822ad88-7a3d-489a-9cdd-11e5745240c4 for instance 695586a7-2b4d-477b-ab83-9e74f5f7078a on hv-cinder-82002 Sep 12 23:58:43.728081 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-1b4f0c20-11ca-4320-ab97-3b3aa91f9e20 req-7d0e68be-ad5d-4bab-a393-6dd6f5a09b96 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069541 Sep 12 23:58:43.729364 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 306/617] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:58:44.102795 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c60c248e-2dd5-48bb-a418-9a5c6de3a2ce tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:44.103568 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c60c248e-2dd5-48bb-a418-9a5c6de3a2ce tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:44.106403 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell0:SELECT=2 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:58:44.113400 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c60c248e-2dd5-48bb-a418-9a5c6de3a2ce tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:44.113991 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c60c248e-2dd5-48bb-a418-9a5c6de3a2ce tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:44.114542 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c60c248e-2dd5-48bb-a418-9a5c6de3a2ce tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:44.115540 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c60c248e-2dd5-48bb-a418-9a5c6de3a2ce tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:44.116078 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c60c248e-2dd5-48bb-a418-9a5c6de3a2ce tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:44.116734 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c60c248e-2dd5-48bb-a418-9a5c6de3a2ce tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:44.188402 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-aab91cb6-afc0-485c-9ecf-9dda781c3982 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:44.189297 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-aab91cb6-afc0-485c-9ecf-9dda781c3982 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 695586a7-2b4d-477b-ab83-9e74f5f7078a] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:44.199199 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aab91cb6-afc0-485c-9ecf-9dda781c3982 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:44.200103 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aab91cb6-afc0-485c-9ecf-9dda781c3982 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:44.200790 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aab91cb6-afc0-485c-9ecf-9dda781c3982 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:44.201601 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aab91cb6-afc0-485c-9ecf-9dda781c3982 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:44.202206 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aab91cb6-afc0-485c-9ecf-9dda781c3982 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:44.202746 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aab91cb6-afc0-485c-9ecf-9dda781c3982 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:44.245383 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aab91cb6-afc0-485c-9ecf-9dda781c3982 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:44.245872 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aab91cb6-afc0-485c-9ecf-9dda781c3982 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:44.246300 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-aab91cb6-afc0-485c-9ecf-9dda781c3982 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:44.247653 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.objects.instance [None req-aab91cb6-afc0-485c-9ecf-9dda781c3982 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lazy-loading 'fault' on Instance uuid 695586a7-2b4d-477b-ab83-9e74f5f7078a {{(pid=126976) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 23:58:44.298340 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c60c248e-2dd5-48bb-a418-9a5c6de3a2ce tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:44.301867 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell0:SELECT=12 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:58:44.315948 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c60c248e-2dd5-48bb-a418-9a5c6de3a2ce tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5" status: 200 len: 1368 microversion: 2.1 time: 0.217659 Sep 12 23:58:44.317461 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 312/618] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:58:44 2022] GET /compute/v2.1/servers/b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5 => generated 1368 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:58:44.333900 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-aab91cb6-afc0-485c-9ecf-9dda781c3982 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76eb39c2010e43aaa0a01caaea3a38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c458cf41ded4113a09fb07e10d81d39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:44.350440 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-aab91cb6-afc0-485c-9ecf-9dda781c3982 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a" status: 200 len: 1312 microversion: 2.1 time: 0.168061 Sep 12 23:58:44.351993 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 307/619] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:58:44 2022] GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a => generated 1312 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:58:44.477948 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c72bda7a-b08b-409d-b977-6802cf2d5a1b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:44.478896 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c72bda7a-b08b-409d-b977-6802cf2d5a1b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:44.489960 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c72bda7a-b08b-409d-b977-6802cf2d5a1b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:44.491243 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c72bda7a-b08b-409d-b977-6802cf2d5a1b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:44.492060 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c72bda7a-b08b-409d-b977-6802cf2d5a1b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:44.493332 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c72bda7a-b08b-409d-b977-6802cf2d5a1b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:44.494140 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c72bda7a-b08b-409d-b977-6802cf2d5a1b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:44.494863 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c72bda7a-b08b-409d-b977-6802cf2d5a1b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:44.666880 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c72bda7a-b08b-409d-b977-6802cf2d5a1b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:44.675962 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c72bda7a-b08b-409d-b977-6802cf2d5a1b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:44.677425 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c72bda7a-b08b-409d-b977-6802cf2d5a1b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:44.678630 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c72bda7a-b08b-409d-b977-6802cf2d5a1b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1723 microversion: 2.20 time: 0.207143 Sep 12 23:58:44.679203 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 313/620] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:58:44 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:58:45.354813 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-bba9c81f-425f-4ec2-9699-13654eed2947 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:45.355574 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-bba9c81f-425f-4ec2-9699-13654eed2947 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:45.363462 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bba9c81f-425f-4ec2-9699-13654eed2947 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:45.364009 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bba9c81f-425f-4ec2-9699-13654eed2947 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:45.364527 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bba9c81f-425f-4ec2-9699-13654eed2947 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:45.365322 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bba9c81f-425f-4ec2-9699-13654eed2947 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:45.365858 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bba9c81f-425f-4ec2-9699-13654eed2947 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:45.366345 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bba9c81f-425f-4ec2-9699-13654eed2947 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:45.387297 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-532120e7-7353-4923-9d55-8950e23145c1 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:45.388483 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-532120e7-7353-4923-9d55-8950e23145c1 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] [instance: 695586a7-2b4d-477b-ab83-9e74f5f7078a] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:45.397828 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-532120e7-7353-4923-9d55-8950e23145c1 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:45.398482 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-532120e7-7353-4923-9d55-8950e23145c1 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:45.399074 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-532120e7-7353-4923-9d55-8950e23145c1 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:45.400049 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-532120e7-7353-4923-9d55-8950e23145c1 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:45.400675 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-532120e7-7353-4923-9d55-8950e23145c1 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:45.401208 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-532120e7-7353-4923-9d55-8950e23145c1 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:45.420243 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-532120e7-7353-4923-9d55-8950e23145c1 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] HTTP exception thrown: Instance 695586a7-2b4d-477b-ab83-9e74f5f7078a could not be found. Sep 12 23:58:45.423297 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-532120e7-7353-4923-9d55-8950e23145c1 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Request method failure captured: Sep 12 23:58:45.423297 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: request: GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a HTTP/1.1 Sep 12 23:58:45.423297 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept: application/json Sep 12 23:58:45.423297 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Sep 12 23:58:45.423297 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Connection: close Sep 12 23:58:45.423297 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Length: 0 Sep 12 23:58:45.423297 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Type: application/json Sep 12 23:58:45.423297 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Host: 10.222.0.26 Sep 12 23:58:45.423297 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Sep 12 23:58:45.423297 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Sep 12 23:58:45.423297 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjH8ZuStW1XXoPQe5y95eOpKYZF0F7YBvJw_27e2kYLBySngK1oyC8cbK16WrSBBy5I-zldm72baODkX7E0kbSH3YQJRovD2YiBAj_9m-miREAelhxMrO-4StKyBWO2wiypQKnAsHCgsduOcFVztxSrPSWmh7ZuLOXLc3LDIycAkgHl0E Sep 12 23:58:45.423297 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Sep 12 23:58:45.423297 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Sep 12 23:58:45.423297 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Sep 12 23:58:45.423297 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Sep 12 23:58:45.423297 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Sep 12 23:58:45.423297 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Sep 12 23:58:45.423297 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Id: 6c458cf41ded4113a09fb07e10d81d39 Sep 12 23:58:45.423297 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2096714212 Sep 12 23:58:45.423297 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Role: member,reader Sep 12 23:58:45.423297 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Roles: member,reader Sep 12 23:58:45.426019 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6c458cf41ded4113a09fb07e10d81d39"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6c458cf41ded4113a09fb07e10d81d39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6c458cf41ded4113a09fb07e10d81d39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6c458cf41ded4113a09fb07e10d81d39"}]}] Sep 12 23:58:45.426019 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2096714212 Sep 12 23:58:45.426019 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Id: 6c458cf41ded4113a09fb07e10d81d39 Sep 12 23:58:45.426019 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2096714212 Sep 12 23:58:45.426019 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User: tempest-ServerRescueNegativeTestJSON-2096714212-project Sep 12 23:58:45.426019 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Sep 12 23:58:45.426019 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Sep 12 23:58:45.426019 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Id: 76eb39c2010e43aaa0a01caaea3a38b9 Sep 12 23:58:45.426019 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2096714212-project Sep 12 23:58:45.426019 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: method: > Sep 12 23:58:45.426019 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: exception: Instance 695586a7-2b4d-477b-ab83-9e74f5f7078a could not be found. Sep 12 23:58:45.426019 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: action_args: {'id': '695586a7-2b4d-477b-ab83-9e74f5f7078a'} Sep 12 23:58:45.427855 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:58:45.427855 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:58:45.427855 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:58:45.427855 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:58:45.427855 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:58:45.427855 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:58:45.427855 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:58:45.427855 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:58:45.427855 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:58:45.427855 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:58:45.427855 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 695586a7-2b4d-477b-ab83-9e74f5f7078a could not be found. Sep 12 23:58:45.427855 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:58:45.427855 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:58:45.427855 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:58:45.427855 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:58:45.427855 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:58:45.427855 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:58:45.427855 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:58:45.427855 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:58:45.427855 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:58:45.431071 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:58:45.431071 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 23:58:45.431071 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 23:58:45.431071 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:58:45.431071 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:58:45.431071 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:58:45.431071 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:58:45.431071 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 695586a7-2b4d-477b-ab83-9e74f5f7078a could not be found. Sep 12 23:58:45.431071 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:58:45.431071 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:58:45.431071 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:58:45.431071 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:58:45.431071 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:58:45.431071 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:58:45.431071 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:58:45.431071 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:58:45.431071 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 695586a7-2b4d-477b-ab83-9e74f5f7078a could not be found. Sep 12 23:58:45.431071 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:58:45.433591 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-532120e7-7353-4923-9d55-8950e23145c1 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] Returning 404 to user: Instance 695586a7-2b4d-477b-ab83-9e74f5f7078a could not be found. {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:58:45.433591 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-532120e7-7353-4923-9d55-8950e23145c1 tempest-ServerRescueNegativeTestJSON-2096714212 tempest-ServerRescueNegativeTestJSON-2096714212-project] 10.222.0.26 "GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a" status: 404 len: 111 microversion: 2.1 time: 0.043043 Sep 12 23:58:45.433591 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 314/621] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:58:45 2022] GET /compute/v2.1/servers/695586a7-2b4d-477b-ab83-9e74f5f7078a => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 12 23:58:45.560415 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-bba9c81f-425f-4ec2-9699-13654eed2947 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:45.575067 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-bba9c81f-425f-4ec2-9699-13654eed2947 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5" status: 200 len: 1368 microversion: 2.1 time: 0.223932 Sep 12 23:58:45.576156 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 308/622] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:58:45 2022] GET /compute/v2.1/servers/b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5 => generated 1368 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:58:45.707512 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-01c68e53-4f23-40e3-909f-7a568af74e49 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:45.708427 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-01c68e53-4f23-40e3-909f-7a568af74e49 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:45.717785 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-01c68e53-4f23-40e3-909f-7a568af74e49 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:45.718489 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-01c68e53-4f23-40e3-909f-7a568af74e49 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:45.719121 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-01c68e53-4f23-40e3-909f-7a568af74e49 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:45.720167 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-01c68e53-4f23-40e3-909f-7a568af74e49 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:45.721178 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-01c68e53-4f23-40e3-909f-7a568af74e49 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:45.721786 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-01c68e53-4f23-40e3-909f-7a568af74e49 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:45.745734 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:58:45.921104 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-01c68e53-4f23-40e3-909f-7a568af74e49 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:45.922207 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-74c3ee82-2fe7-4e62-92b9-7a4a5b40c703 req-4b1d213c-3cc8-4444-9c46-bcde2c0379ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5", "name": "network-vif-plugged", "status": "completed", "tag": "3518a015-4b9d-49ce-83c7-2bc6c147a0ba"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:58:45.930314 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-01c68e53-4f23-40e3-909f-7a568af74e49 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:45.932329 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-01c68e53-4f23-40e3-909f-7a568af74e49 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:45.934165 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-01c68e53-4f23-40e3-909f-7a568af74e49 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1723 microversion: 2.20 time: 0.233199 Sep 12 23:58:45.939368 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 315/623] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:58:45 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1723 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:58:45.945530 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-74c3ee82-2fe7-4e62-92b9-7a4a5b40c703 req-4b1d213c-3cc8-4444-9c46-bcde2c0379ac service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:45.946977 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-74c3ee82-2fe7-4e62-92b9-7a4a5b40c703 req-4b1d213c-3cc8-4444-9c46-bcde2c0379ac service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:45.947760 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-74c3ee82-2fe7-4e62-92b9-7a4a5b40c703 req-4b1d213c-3cc8-4444-9c46-bcde2c0379ac service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:45.964365 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-74c3ee82-2fe7-4e62-92b9-7a4a5b40c703 req-4b1d213c-3cc8-4444-9c46-bcde2c0379ac service nova] Creating event network-vif-plugged:3518a015-4b9d-49ce-83c7-2bc6c147a0ba for instance b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5 on hv-cinder-82002 Sep 12 23:58:45.969342 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-74c3ee82-2fe7-4e62-92b9-7a4a5b40c703 req-4b1d213c-3cc8-4444-9c46-bcde2c0379ac service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059022 Sep 12 23:58:45.970509 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 309/624] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:58:46.604532 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e14ea419-eda4-4425-a7c4-9e4a6915bc02 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:46.605203 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e14ea419-eda4-4425-a7c4-9e4a6915bc02 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:46.612945 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e14ea419-eda4-4425-a7c4-9e4a6915bc02 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:46.613421 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e14ea419-eda4-4425-a7c4-9e4a6915bc02 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:46.613882 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e14ea419-eda4-4425-a7c4-9e4a6915bc02 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:46.614629 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e14ea419-eda4-4425-a7c4-9e4a6915bc02 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:46.615069 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e14ea419-eda4-4425-a7c4-9e4a6915bc02 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:46.615540 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e14ea419-eda4-4425-a7c4-9e4a6915bc02 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:46.775974 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-e14ea419-eda4-4425-a7c4-9e4a6915bc02 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:46.784776 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e14ea419-eda4-4425-a7c4-9e4a6915bc02 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5" status: 200 len: 1368 microversion: 2.1 time: 0.184213 Sep 12 23:58:46.785397 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 316/625] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:58:46 2022] GET /compute/v2.1/servers/b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5 => generated 1368 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:58:46.974917 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b57fd5f3-76dc-4f38-9edf-925f465aeb5b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:46.976115 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b57fd5f3-76dc-4f38-9edf-925f465aeb5b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:46.987666 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b57fd5f3-76dc-4f38-9edf-925f465aeb5b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:46.988568 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b57fd5f3-76dc-4f38-9edf-925f465aeb5b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:46.989400 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b57fd5f3-76dc-4f38-9edf-925f465aeb5b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:46.990839 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b57fd5f3-76dc-4f38-9edf-925f465aeb5b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:46.991735 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b57fd5f3-76dc-4f38-9edf-925f465aeb5b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:46.992491 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b57fd5f3-76dc-4f38-9edf-925f465aeb5b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:47.200296 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b57fd5f3-76dc-4f38-9edf-925f465aeb5b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:47.210408 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b57fd5f3-76dc-4f38-9edf-925f465aeb5b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:47.211963 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b57fd5f3-76dc-4f38-9edf-925f465aeb5b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:47.213380 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b57fd5f3-76dc-4f38-9edf-925f465aeb5b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1723 microversion: 2.20 time: 0.248112 Sep 12 23:58:47.214042 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 310/626] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:58:46 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1723 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:58:47.815664 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ba320cb1-a08b-4370-b33a-b79e2787a6ef tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:47.818702 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ba320cb1-a08b-4370-b33a-b79e2787a6ef tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:47.831947 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ba320cb1-a08b-4370-b33a-b79e2787a6ef tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:47.832934 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ba320cb1-a08b-4370-b33a-b79e2787a6ef tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:47.833820 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ba320cb1-a08b-4370-b33a-b79e2787a6ef tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:47.835156 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ba320cb1-a08b-4370-b33a-b79e2787a6ef tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:47.836420 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ba320cb1-a08b-4370-b33a-b79e2787a6ef tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:47.837232 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ba320cb1-a08b-4370-b33a-b79e2787a6ef tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:48.170871 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ba320cb1-a08b-4370-b33a-b79e2787a6ef tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:48.186098 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ba320cb1-a08b-4370-b33a-b79e2787a6ef tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5" status: 200 len: 1368 microversion: 2.1 time: 0.379566 Sep 12 23:58:48.191277 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 317/627] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:58:47 2022] GET /compute/v2.1/servers/b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5 => generated 1368 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:58:48.255022 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9eca9a81-b36d-4acd-9094-6a0c59ad2e9b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:48.256050 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9eca9a81-b36d-4acd-9094-6a0c59ad2e9b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:48.264022 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9eca9a81-b36d-4acd-9094-6a0c59ad2e9b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:48.264524 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9eca9a81-b36d-4acd-9094-6a0c59ad2e9b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:48.264966 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9eca9a81-b36d-4acd-9094-6a0c59ad2e9b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:48.265764 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9eca9a81-b36d-4acd-9094-6a0c59ad2e9b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:48.266248 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9eca9a81-b36d-4acd-9094-6a0c59ad2e9b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:48.266652 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9eca9a81-b36d-4acd-9094-6a0c59ad2e9b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:48.431207 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-9eca9a81-b36d-4acd-9094-6a0c59ad2e9b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:48.440747 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-9eca9a81-b36d-4acd-9094-6a0c59ad2e9b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:48.442315 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-9eca9a81-b36d-4acd-9094-6a0c59ad2e9b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:48.444314 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9eca9a81-b36d-4acd-9094-6a0c59ad2e9b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1723 microversion: 2.20 time: 0.193247 Sep 12 23:58:48.445448 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 311/628] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:58:48 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 23:58:49.211682 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c852401c-c769-4a83-8dc1-bcb25535010a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:49.212406 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c852401c-c769-4a83-8dc1-bcb25535010a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:49.219800 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c852401c-c769-4a83-8dc1-bcb25535010a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:49.220778 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c852401c-c769-4a83-8dc1-bcb25535010a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:49.221458 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c852401c-c769-4a83-8dc1-bcb25535010a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:49.222231 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c852401c-c769-4a83-8dc1-bcb25535010a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:49.222680 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c852401c-c769-4a83-8dc1-bcb25535010a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:49.223374 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c852401c-c769-4a83-8dc1-bcb25535010a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:49.482439 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c852401c-c769-4a83-8dc1-bcb25535010a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:49.492641 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1dbceee1-ce40-4e39-a724-3facd763daa1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:49.494833 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1dbceee1-ce40-4e39-a724-3facd763daa1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:49.498874 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c852401c-c769-4a83-8dc1-bcb25535010a tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5" status: 200 len: 1558 microversion: 2.1 time: 0.290894 Sep 12 23:58:49.514835 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 318/629] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:58:49 2022] GET /compute/v2.1/servers/b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5 => generated 1558 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:58:49.530027 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1dbceee1-ce40-4e39-a724-3facd763daa1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:49.531567 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1dbceee1-ce40-4e39-a724-3facd763daa1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:49.532642 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1dbceee1-ce40-4e39-a724-3facd763daa1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:49.534706 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1dbceee1-ce40-4e39-a724-3facd763daa1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:49.536510 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1dbceee1-ce40-4e39-a724-3facd763daa1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:49.538304 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1dbceee1-ce40-4e39-a724-3facd763daa1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:49.542565 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b26fc082-0335-4465-91c2-5926ba9c2724 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:49.543155 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b26fc082-0335-4465-91c2-5926ba9c2724 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:49.551151 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b26fc082-0335-4465-91c2-5926ba9c2724 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:49.551702 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b26fc082-0335-4465-91c2-5926ba9c2724 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:49.552148 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b26fc082-0335-4465-91c2-5926ba9c2724 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:49.553025 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b26fc082-0335-4465-91c2-5926ba9c2724 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:49.553491 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b26fc082-0335-4465-91c2-5926ba9c2724 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:49.554462 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b26fc082-0335-4465-91c2-5926ba9c2724 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:49.735616 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b26fc082-0335-4465-91c2-5926ba9c2724 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.197281 Sep 12 23:58:49.741587 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 319/630] 10.222.0.26 () {58 vars in 1275 bytes} [Mon Sep 12 23:58:49 2022] GET /compute/v2.1/servers/b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5/os-interface => generated 284 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 23:58:49.881311 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-1dbceee1-ce40-4e39-a724-3facd763daa1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:49.892344 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-1dbceee1-ce40-4e39-a724-3facd763daa1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:49.893964 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-1dbceee1-ce40-4e39-a724-3facd763daa1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:49.895190 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1dbceee1-ce40-4e39-a724-3facd763daa1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1723 microversion: 2.20 time: 0.410392 Sep 12 23:58:49.896158 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 312/631] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:58:49 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1723 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:58:50.924845 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-76b7952b-2bee-433f-aa38-2cac32230fb2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:50.926179 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-76b7952b-2bee-433f-aa38-2cac32230fb2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:50.934745 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-76b7952b-2bee-433f-aa38-2cac32230fb2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:50.935829 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-76b7952b-2bee-433f-aa38-2cac32230fb2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:50.936544 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-76b7952b-2bee-433f-aa38-2cac32230fb2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:50.937437 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-76b7952b-2bee-433f-aa38-2cac32230fb2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:50.938187 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-76b7952b-2bee-433f-aa38-2cac32230fb2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:50.939311 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-76b7952b-2bee-433f-aa38-2cac32230fb2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:51.154072 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-76b7952b-2bee-433f-aa38-2cac32230fb2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:51.164368 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-76b7952b-2bee-433f-aa38-2cac32230fb2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:51.166020 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-76b7952b-2bee-433f-aa38-2cac32230fb2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:51.167383 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-76b7952b-2bee-433f-aa38-2cac32230fb2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1744 microversion: 2.20 time: 0.248410 Sep 12 23:58:51.168212 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 320/632] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:58:50 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1744 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 23:58:51.829492 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-c7142418-0dd5-4fc1-b475-be2d05d94159 req-f98573c9-fab5-48d0-ac8d-2e0ee1802e69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5", "tag": "3518a015-4b9d-49ce-83c7-2bc6c147a0ba"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:58:51.847141 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-c7142418-0dd5-4fc1-b475-be2d05d94159 req-f98573c9-fab5-48d0-ac8d-2e0ee1802e69 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:51.847972 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-c7142418-0dd5-4fc1-b475-be2d05d94159 req-f98573c9-fab5-48d0-ac8d-2e0ee1802e69 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:51.848808 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-c7142418-0dd5-4fc1-b475-be2d05d94159 req-f98573c9-fab5-48d0-ac8d-2e0ee1802e69 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:51.868737 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-c7142418-0dd5-4fc1-b475-be2d05d94159 req-f98573c9-fab5-48d0-ac8d-2e0ee1802e69 service nova] Creating event network-changed:3518a015-4b9d-49ce-83c7-2bc6c147a0ba for instance b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5 on hv-cinder-82002 Sep 12 23:58:51.878622 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-c7142418-0dd5-4fc1-b475-be2d05d94159 req-f98573c9-fab5-48d0-ac8d-2e0ee1802e69 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.360314 Sep 12 23:58:51.879792 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 313/633] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:58:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:58:52.194462 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f029d725-dcf1-406d-a87a-846e0f907267 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:52.195389 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f029d725-dcf1-406d-a87a-846e0f907267 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:52.206691 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f029d725-dcf1-406d-a87a-846e0f907267 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:52.207733 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f029d725-dcf1-406d-a87a-846e0f907267 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:52.208986 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f029d725-dcf1-406d-a87a-846e0f907267 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:52.210996 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f029d725-dcf1-406d-a87a-846e0f907267 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:52.212454 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f029d725-dcf1-406d-a87a-846e0f907267 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:52.213413 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f029d725-dcf1-406d-a87a-846e0f907267 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:52.537103 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f029d725-dcf1-406d-a87a-846e0f907267 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:52.558817 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f029d725-dcf1-406d-a87a-846e0f907267 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:52.564536 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f029d725-dcf1-406d-a87a-846e0f907267 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:52.566196 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f029d725-dcf1-406d-a87a-846e0f907267 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1744 microversion: 2.20 time: 0.375771 Sep 12 23:58:52.569712 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 321/634] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:58:52 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1744 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 23:58:52.749412 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a72694e1-cecd-4c5b-bc0a-56f0c12b3681 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:52.751967 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a72694e1-cecd-4c5b-bc0a-56f0c12b3681 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:52.758555 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a72694e1-cecd-4c5b-bc0a-56f0c12b3681 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:52.759103 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a72694e1-cecd-4c5b-bc0a-56f0c12b3681 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:52.760282 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a72694e1-cecd-4c5b-bc0a-56f0c12b3681 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:52.761133 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a72694e1-cecd-4c5b-bc0a-56f0c12b3681 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:52.761602 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a72694e1-cecd-4c5b-bc0a-56f0c12b3681 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:52.762236 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a72694e1-cecd-4c5b-bc0a-56f0c12b3681 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:52.828611 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a72694e1-cecd-4c5b-bc0a-56f0c12b3681 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.090204 Sep 12 23:58:52.829207 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 314/635] 10.222.0.26 () {58 vars in 1302 bytes} [Mon Sep 12 23:58:52 2022] GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c/os-volume_attachments => generated 25 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 12 23:58:52.919729 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5faaffa8-e704-480d-91f2-49c51ea541bf tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:52.920517 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5faaffa8-e704-480d-91f2-49c51ea541bf tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:52.927249 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5faaffa8-e704-480d-91f2-49c51ea541bf tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:52.927932 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5faaffa8-e704-480d-91f2-49c51ea541bf tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:52.928526 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5faaffa8-e704-480d-91f2-49c51ea541bf tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:52.929405 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5faaffa8-e704-480d-91f2-49c51ea541bf tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:52.930199 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5faaffa8-e704-480d-91f2-49c51ea541bf tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:52.930984 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5faaffa8-e704-480d-91f2-49c51ea541bf tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:52.966130 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5faaffa8-e704-480d-91f2-49c51ea541bf tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Going to try to terminate instance {{(pid=126975) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 23:58:53.102172 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5faaffa8-e704-480d-91f2-49c51ea541bf tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "DELETE /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c" status: 204 len: 0 microversion: 2.1 time: 0.189269 Sep 12 23:58:53.104042 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 322/636] 10.222.0.26 () {58 vars in 1239 bytes} [Mon Sep 12 23:58:52 2022] DELETE /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 12 23:58:53.113911 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ea9dbbf7-ca14-410d-adee-079023aee747 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:53.114551 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ea9dbbf7-ca14-410d-adee-079023aee747 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:53.126311 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ea9dbbf7-ca14-410d-adee-079023aee747 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:53.128188 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ea9dbbf7-ca14-410d-adee-079023aee747 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:53.129237 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ea9dbbf7-ca14-410d-adee-079023aee747 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:53.131025 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ea9dbbf7-ca14-410d-adee-079023aee747 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:53.133407 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ea9dbbf7-ca14-410d-adee-079023aee747 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:53.134627 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ea9dbbf7-ca14-410d-adee-079023aee747 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:53.385043 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ea9dbbf7-ca14-410d-adee-079023aee747 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:53.395966 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ea9dbbf7-ca14-410d-adee-079023aee747 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c" status: 200 len: 1672 microversion: 2.1 time: 0.287035 Sep 12 23:58:53.413037 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 315/637] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:58:53 2022] GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c => generated 1672 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:58:53.616923 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-013e06e0-eb86-4ce9-98ba-d513eb4cd1df tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:53.619273 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-013e06e0-eb86-4ce9-98ba-d513eb4cd1df tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:53.632507 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-013e06e0-eb86-4ce9-98ba-d513eb4cd1df tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:53.633111 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-013e06e0-eb86-4ce9-98ba-d513eb4cd1df tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:53.633400 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-013e06e0-eb86-4ce9-98ba-d513eb4cd1df tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:53.634339 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-013e06e0-eb86-4ce9-98ba-d513eb4cd1df tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:53.634753 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-013e06e0-eb86-4ce9-98ba-d513eb4cd1df tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:53.635167 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-013e06e0-eb86-4ce9-98ba-d513eb4cd1df tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:53.885813 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-013e06e0-eb86-4ce9-98ba-d513eb4cd1df tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:53.901296 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-013e06e0-eb86-4ce9-98ba-d513eb4cd1df tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:53.908717 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-013e06e0-eb86-4ce9-98ba-d513eb4cd1df tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:53.910756 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-013e06e0-eb86-4ce9-98ba-d513eb4cd1df tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1739 microversion: 2.20 time: 0.298110 Sep 12 23:58:53.935718 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-1c3fc7ca-26fe-459c-89b9-1215cb046bd3 req-0e1a6e03-54c0-4c3f-9aea-29fb85cbd372 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3088bc31-f3ff-476d-a0ad-9f10186b442f", "name": "network-vif-plugged", "status": "completed", "tag": "8a984b84-cffe-442a-8574-f76c08213db0"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:58:53.943792 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 323/638] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:58:53 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1739 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:58:53.950519 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-1c3fc7ca-26fe-459c-89b9-1215cb046bd3 req-0e1a6e03-54c0-4c3f-9aea-29fb85cbd372 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:53.952292 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-1c3fc7ca-26fe-459c-89b9-1215cb046bd3 req-0e1a6e03-54c0-4c3f-9aea-29fb85cbd372 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:53.953114 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-1c3fc7ca-26fe-459c-89b9-1215cb046bd3 req-0e1a6e03-54c0-4c3f-9aea-29fb85cbd372 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:53.970263 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-1c3fc7ca-26fe-459c-89b9-1215cb046bd3 req-0e1a6e03-54c0-4c3f-9aea-29fb85cbd372 service nova] Creating event network-vif-plugged:8a984b84-cffe-442a-8574-f76c08213db0 for instance 3088bc31-f3ff-476d-a0ad-9f10186b442f on hv-cinder-82002 Sep 12 23:58:53.978726 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-1c3fc7ca-26fe-459c-89b9-1215cb046bd3 req-0e1a6e03-54c0-4c3f-9aea-29fb85cbd372 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050720 Sep 12 23:58:53.979942 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 316/639] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:58:54.427975 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-471a340a-c5af-4020-8bf3-207e39dffb42 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:54.428620 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-471a340a-c5af-4020-8bf3-207e39dffb42 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:54.436434 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-471a340a-c5af-4020-8bf3-207e39dffb42 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:54.437327 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-471a340a-c5af-4020-8bf3-207e39dffb42 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:54.437820 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-471a340a-c5af-4020-8bf3-207e39dffb42 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:54.438749 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-471a340a-c5af-4020-8bf3-207e39dffb42 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:54.439404 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-471a340a-c5af-4020-8bf3-207e39dffb42 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:54.439893 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-471a340a-c5af-4020-8bf3-207e39dffb42 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:54.686706 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-471a340a-c5af-4020-8bf3-207e39dffb42 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:54.697218 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-471a340a-c5af-4020-8bf3-207e39dffb42 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c" status: 200 len: 1672 microversion: 2.1 time: 0.273304 Sep 12 23:58:54.707643 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 324/640] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:58:54 2022] GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c => generated 1672 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:58:54.964163 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d11d2549-1174-4826-85a4-767e5b52aded tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:54.966294 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d11d2549-1174-4826-85a4-767e5b52aded tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:54.998731 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:58:55.006580 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d11d2549-1174-4826-85a4-767e5b52aded tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:55.008208 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d11d2549-1174-4826-85a4-767e5b52aded tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:55.009558 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d11d2549-1174-4826-85a4-767e5b52aded tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:55.011995 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d11d2549-1174-4826-85a4-767e5b52aded tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:55.012713 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d11d2549-1174-4826-85a4-767e5b52aded tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:55.013726 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d11d2549-1174-4826-85a4-767e5b52aded tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:55.281916 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d11d2549-1174-4826-85a4-767e5b52aded tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:55.312693 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d11d2549-1174-4826-85a4-767e5b52aded tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:55.320228 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d11d2549-1174-4826-85a4-767e5b52aded tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:55.321849 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d11d2549-1174-4826-85a4-767e5b52aded tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1739 microversion: 2.20 time: 0.369107 Sep 12 23:58:55.335264 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 317/641] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:58:54 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1739 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:58:55.722631 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-69d67467-9ebb-4531-9d25-57f8f8320476 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:55.724019 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-69d67467-9ebb-4531-9d25-57f8f8320476 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:55.741395 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-69d67467-9ebb-4531-9d25-57f8f8320476 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:55.745258 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-69d67467-9ebb-4531-9d25-57f8f8320476 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:55.747811 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-69d67467-9ebb-4531-9d25-57f8f8320476 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:55.749063 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-69d67467-9ebb-4531-9d25-57f8f8320476 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:55.751027 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-69d67467-9ebb-4531-9d25-57f8f8320476 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:55.752069 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-69d67467-9ebb-4531-9d25-57f8f8320476 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:56.129542 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-69d67467-9ebb-4531-9d25-57f8f8320476 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:56.150744 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-69d67467-9ebb-4531-9d25-57f8f8320476 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c" status: 200 len: 1672 microversion: 2.1 time: 0.433436 Sep 12 23:58:56.152619 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 325/642] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:58:55 2022] GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c => generated 1672 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:58:56.357285 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3070a2d0-f033-4d0c-b694-07b6f003959c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:56.358315 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3070a2d0-f033-4d0c-b694-07b6f003959c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:56.372894 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3070a2d0-f033-4d0c-b694-07b6f003959c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:56.374711 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3070a2d0-f033-4d0c-b694-07b6f003959c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:56.376462 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3070a2d0-f033-4d0c-b694-07b6f003959c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:56.380697 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3070a2d0-f033-4d0c-b694-07b6f003959c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:56.383545 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3070a2d0-f033-4d0c-b694-07b6f003959c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:56.385102 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3070a2d0-f033-4d0c-b694-07b6f003959c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:56.856195 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3070a2d0-f033-4d0c-b694-07b6f003959c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:56.889939 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3070a2d0-f033-4d0c-b694-07b6f003959c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:56.903813 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3070a2d0-f033-4d0c-b694-07b6f003959c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:56.907117 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3070a2d0-f033-4d0c-b694-07b6f003959c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1739 microversion: 2.20 time: 0.553999 Sep 12 23:58:56.908347 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 318/643] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:58:56 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1739 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 23:58:57.199524 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e0b4420f-8d57-410c-bc09-5314b54ca4fb tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:57.201034 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e0b4420f-8d57-410c-bc09-5314b54ca4fb tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:57.216663 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e0b4420f-8d57-410c-bc09-5314b54ca4fb tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:57.217307 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e0b4420f-8d57-410c-bc09-5314b54ca4fb tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:57.217841 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e0b4420f-8d57-410c-bc09-5314b54ca4fb tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:57.218719 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e0b4420f-8d57-410c-bc09-5314b54ca4fb tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:57.219327 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e0b4420f-8d57-410c-bc09-5314b54ca4fb tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:57.219838 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e0b4420f-8d57-410c-bc09-5314b54ca4fb tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:57.339543 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e0b4420f-8d57-410c-bc09-5314b54ca4fb tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:57.358843 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e0b4420f-8d57-410c-bc09-5314b54ca4fb tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c" status: 200 len: 1320 microversion: 2.1 time: 0.180247 Sep 12 23:58:57.373372 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 319/644] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:58:57 2022] GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c => generated 1320 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:58:57.420200 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-5833d318-60f4-4435-9594-5ede516ac739 req-7defa736-ef89-4949-93ba-1ccb500a47aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df2886ea-3e42-4713-82e6-bacd4de26d8c", "name": "network-vif-deleted", "tag": "c4502ec9-84fa-4339-b714-5cfae4677e4e"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:58:57.450992 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-5833d318-60f4-4435-9594-5ede516ac739 req-7defa736-ef89-4949-93ba-1ccb500a47aa service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:57.467342 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-5833d318-60f4-4435-9594-5ede516ac739 req-7defa736-ef89-4949-93ba-1ccb500a47aa service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:57.472600 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-5833d318-60f4-4435-9594-5ede516ac739 req-7defa736-ef89-4949-93ba-1ccb500a47aa service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:57.496906 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-5833d318-60f4-4435-9594-5ede516ac739 req-7defa736-ef89-4949-93ba-1ccb500a47aa service nova] Creating event network-vif-deleted:c4502ec9-84fa-4339-b714-5cfae4677e4e for instance df2886ea-3e42-4713-82e6-bacd4de26d8c on hv-cinder-82002 Sep 12 23:58:57.507389 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-5833d318-60f4-4435-9594-5ede516ac739 req-7defa736-ef89-4949-93ba-1ccb500a47aa service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.431691 Sep 12 23:58:57.509672 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 326/645] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:58:57.939780 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b926de55-d948-4eb7-9cc0-1d7b930d04c1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:57.940354 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b926de55-d948-4eb7-9cc0-1d7b930d04c1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:57.950304 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b926de55-d948-4eb7-9cc0-1d7b930d04c1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:57.950809 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b926de55-d948-4eb7-9cc0-1d7b930d04c1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:57.951268 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b926de55-d948-4eb7-9cc0-1d7b930d04c1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:57.951983 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b926de55-d948-4eb7-9cc0-1d7b930d04c1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:57.952434 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b926de55-d948-4eb7-9cc0-1d7b930d04c1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:57.957598 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b926de55-d948-4eb7-9cc0-1d7b930d04c1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:58.230671 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b926de55-d948-4eb7-9cc0-1d7b930d04c1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:58.246505 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b926de55-d948-4eb7-9cc0-1d7b930d04c1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:58.249203 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b926de55-d948-4eb7-9cc0-1d7b930d04c1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:58.251012 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b926de55-d948-4eb7-9cc0-1d7b930d04c1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1739 microversion: 2.20 time: 0.315826 Sep 12 23:58:58.271923 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 320/646] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:58:57 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1739 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 23:58:58.398330 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8384be5f-ec13-4e15-870b-e9c54f3d0a1a tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:58.399036 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8384be5f-ec13-4e15-870b-e9c54f3d0a1a tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:58.414926 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8384be5f-ec13-4e15-870b-e9c54f3d0a1a tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:58.415556 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8384be5f-ec13-4e15-870b-e9c54f3d0a1a tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:58.416341 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8384be5f-ec13-4e15-870b-e9c54f3d0a1a tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:58.421408 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8384be5f-ec13-4e15-870b-e9c54f3d0a1a tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:58.422472 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8384be5f-ec13-4e15-870b-e9c54f3d0a1a tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:58.427479 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8384be5f-ec13-4e15-870b-e9c54f3d0a1a tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:58.451249 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-8384be5f-ec13-4e15-870b-e9c54f3d0a1a tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] HTTP exception thrown: Instance df2886ea-3e42-4713-82e6-bacd4de26d8c could not be found. Sep 12 23:58:58.453491 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8384be5f-ec13-4e15-870b-e9c54f3d0a1a tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Request method failure captured: Sep 12 23:58:58.453491 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: request: GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c HTTP/1.1 Sep 12 23:58:58.453491 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept: application/json Sep 12 23:58:58.453491 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Sep 12 23:58:58.453491 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Connection: close Sep 12 23:58:58.453491 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Length: 0 Sep 12 23:58:58.453491 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Type: application/json Sep 12 23:58:58.453491 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Host: 10.222.0.26 Sep 12 23:58:58.453491 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Sep 12 23:58:58.453491 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Sep 12 23:58:58.453491 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjH8bc4bJdVDTQjQ-S_BrNKXiAQaJrogJrt6IBcOL1djQpAvT8zwXOYVZlnrngFM7OG_4Ir8seGcj-mSqgkiw6n-dR85_T4cZlf5h7G8ApBZL33D25KZPqSRXq1fcMYh9s_4RqV8zn646ssP0OB_eBcWsbUyrEYN7lSok4iWBOPJYkWAE Sep 12 23:58:58.453491 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Sep 12 23:58:58.453491 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Sep 12 23:58:58.453491 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Sep 12 23:58:58.453491 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Sep 12 23:58:58.453491 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Sep 12 23:58:58.453491 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Sep 12 23:58:58.453491 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Id: ffc5ce52ae574b82bda143e766bcec80 Sep 12 23:58:58.453491 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-AttachVolumeTestJSON-1068932957 Sep 12 23:58:58.453491 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Role: member,reader Sep 12 23:58:58.453491 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Roles: member,reader Sep 12 23:58:58.455142 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ffc5ce52ae574b82bda143e766bcec80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ffc5ce52ae574b82bda143e766bcec80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ffc5ce52ae574b82bda143e766bcec80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ffc5ce52ae574b82bda143e766bcec80"}]}] Sep 12 23:58:58.455142 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-AttachVolumeTestJSON-1068932957 Sep 12 23:58:58.455142 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Id: ffc5ce52ae574b82bda143e766bcec80 Sep 12 23:58:58.455142 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1068932957 Sep 12 23:58:58.455142 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User: tempest-AttachVolumeTestJSON-1068932957-project Sep 12 23:58:58.455142 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Sep 12 23:58:58.455142 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Sep 12 23:58:58.455142 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Id: 0d81b048f7e64c53894ad9e9ee33f518 Sep 12 23:58:58.455142 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-AttachVolumeTestJSON-1068932957-project Sep 12 23:58:58.455142 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: method: > Sep 12 23:58:58.455142 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: exception: Instance df2886ea-3e42-4713-82e6-bacd4de26d8c could not be found. Sep 12 23:58:58.455142 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: action_args: {'id': 'df2886ea-3e42-4713-82e6-bacd4de26d8c'} Sep 12 23:58:58.456083 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:58:58.456083 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:58:58.456083 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:58:58.456083 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:58:58.456083 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:58:58.456083 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:58:58.456083 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:58:58.456083 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:58:58.456083 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:58:58.456083 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:58:58.456083 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df2886ea-3e42-4713-82e6-bacd4de26d8c could not be found. Sep 12 23:58:58.456083 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:58:58.456083 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:58:58.456083 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:58:58.456083 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:58:58.456083 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:58:58.456083 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:58:58.456083 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:58:58.456083 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:58:58.456083 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:58:58.457457 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:58:58.457457 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 23:58:58.457457 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 23:58:58.457457 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:58:58.457457 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:58:58.457457 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:58:58.457457 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:58:58.457457 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df2886ea-3e42-4713-82e6-bacd4de26d8c could not be found. Sep 12 23:58:58.457457 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:58:58.457457 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:58:58.457457 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:58:58.457457 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:58:58.457457 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:58:58.457457 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:58:58.457457 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:58:58.457457 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:58:58.457457 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df2886ea-3e42-4713-82e6-bacd4de26d8c could not be found. Sep 12 23:58:58.457457 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:58:58.460433 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8384be5f-ec13-4e15-870b-e9c54f3d0a1a tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Returning 404 to user: Instance df2886ea-3e42-4713-82e6-bacd4de26d8c could not be found. {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:58:58.461595 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8384be5f-ec13-4e15-870b-e9c54f3d0a1a tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c" status: 404 len: 111 microversion: 2.1 time: 0.067883 Sep 12 23:58:58.462680 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 327/647] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:58:58 2022] GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:58:58.471960 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f996f0a9-4a99-4ba4-9a51-3824cdfe9e1c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '.version_select at 0x7fed012a2ee0>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:58.516648 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f996f0a9-4a99-4ba4-9a51-3824cdfe9e1c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-46171062" status: 202 len: 0 microversion: 2.1 time: 0.049428 Sep 12 23:58:58.518305 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 321/648] 10.222.0.26 () {58 vars in 1215 bytes} [Mon Sep 12 23:58:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-46171062 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 23:58:59.282904 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-297cefab-e65f-4672-827a-de902b525e70 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:58:59.283832 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-297cefab-e65f-4672-827a-de902b525e70 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:58:59.299812 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-297cefab-e65f-4672-827a-de902b525e70 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:59.300725 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-297cefab-e65f-4672-827a-de902b525e70 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:59.302132 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-297cefab-e65f-4672-827a-de902b525e70 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:59.304744 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-297cefab-e65f-4672-827a-de902b525e70 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:58:59.305499 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-297cefab-e65f-4672-827a-de902b525e70 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:58:59.306311 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-297cefab-e65f-4672-827a-de902b525e70 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:58:59.517355 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-cd9c6c90-8f07-4904-b6f2-3e94701742aa tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Action: 'create', calling method: .version_select at 0x7fed012d6af0>, body: {"keypair": {"name": "tempest-keypair-1991911507", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOkMLaZevlqu//GgTezxykqSIFsKV04ST6EQ2+8Mtabg/16IIfKOnxi7RxUKcFnJ9HXLYJS9OrweZECWOHamVDMUvR9bh88cB9FnET1UupKfl5ook2nuth4FQxWNny9i3A=="}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:58:59.559336 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-cd9c6c90-8f07-4904-b6f2-3e94701742aa tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Getting quotas for project ffc5ce52ae574b82bda143e766bcec80. Resources: {'key_pairs'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 23:58:59.566553 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-cd9c6c90-8f07-4904-b6f2-3e94701742aa tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Getting quotas for user 0d81b048f7e64c53894ad9e9ee33f518 and project ffc5ce52ae574b82bda143e766bcec80. Resources: {'key_pairs'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 23:58:59.603684 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-cd9c6c90-8f07-4904-b6f2-3e94701742aa tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.090231 Sep 12 23:58:59.604805 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 322/649] 10.222.0.26 () {60 vars in 1159 bytes} [Mon Sep 12 23:58:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:58:59.670569 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-297cefab-e65f-4672-827a-de902b525e70 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:59.695952 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-297cefab-e65f-4672-827a-de902b525e70 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:59.697216 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-297cefab-e65f-4672-827a-de902b525e70 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:58:59.698611 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-297cefab-e65f-4672-827a-de902b525e70 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1739 microversion: 2.20 time: 0.420430 Sep 12 23:58:59.702842 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 328/650] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:58:59 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1739 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:59:00.731042 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-587631c4-de05-42be-a533-aeb1b73cb954 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:00.732496 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-587631c4-de05-42be-a533-aeb1b73cb954 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:00.749606 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-587631c4-de05-42be-a533-aeb1b73cb954 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:00.750732 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-587631c4-de05-42be-a533-aeb1b73cb954 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:00.751842 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-587631c4-de05-42be-a533-aeb1b73cb954 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:00.752855 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-587631c4-de05-42be-a533-aeb1b73cb954 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:00.753530 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-587631c4-de05-42be-a533-aeb1b73cb954 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:00.754296 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-587631c4-de05-42be-a533-aeb1b73cb954 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:01.283153 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-587631c4-de05-42be-a533-aeb1b73cb954 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:01.313241 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-587631c4-de05-42be-a533-aeb1b73cb954 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:01.325273 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-587631c4-de05-42be-a533-aeb1b73cb954 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:01.328725 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-587631c4-de05-42be-a533-aeb1b73cb954 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1739 microversion: 2.20 time: 0.601870 Sep 12 23:59:01.329873 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 323/651] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:59:00 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1739 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:59:01.971341 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3d07b859-96ae-4296-87ad-84b57ebe069b tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1091466002", "imageRef": "22a47167-5e04-441a-a504-d76d82afc776", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "923e930b-b793-481f-a057-be9c6d7f3f9d"}], "security_groups": [{"name": "tempest-securitygroup--1008180093"}], "key_name": "tempest-keypair-1991911507", "user_data": "}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:59:02.148217 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.network.neutron [None req-3d07b859-96ae-4296-87ad-84b57ebe069b tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] validate_networks() for [('923e930b-b793-481f-a057-be9c6d7f3f9d', None, None, None, None, None)] {{(pid=126975) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 23:59:02.360367 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-93cadfac-d183-4808-9176-326c925b7b8b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:02.361912 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-93cadfac-d183-4808-9176-326c925b7b8b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:02.369713 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-93cadfac-d183-4808-9176-326c925b7b8b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:02.370377 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-93cadfac-d183-4808-9176-326c925b7b8b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:02.370964 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-93cadfac-d183-4808-9176-326c925b7b8b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:02.372064 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-93cadfac-d183-4808-9176-326c925b7b8b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:02.373003 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-93cadfac-d183-4808-9176-326c925b7b8b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:02.373582 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-93cadfac-d183-4808-9176-326c925b7b8b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:02.620070 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-93cadfac-d183-4808-9176-326c925b7b8b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:02.632757 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-93cadfac-d183-4808-9176-326c925b7b8b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:02.638823 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-93cadfac-d183-4808-9176-326c925b7b8b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:02.649966 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-93cadfac-d183-4808-9176-326c925b7b8b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1739 microversion: 2.20 time: 0.291557 Sep 12 23:59:02.670141 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 324/652] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:59:02 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1739 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 23:59:02.812440 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-3d07b859-96ae-4296-87ad-84b57ebe069b tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Flavor limits 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 23:59:02.813594 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-3d07b859-96ae-4296-87ad-84b57ebe069b tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Image limits 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 23:59:02.814835 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-3d07b859-96ae-4296-87ad-84b57ebe069b tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Flavor pref 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 23:59:02.815951 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-3d07b859-96ae-4296-87ad-84b57ebe069b tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Image pref 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 23:59:02.817202 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-3d07b859-96ae-4296-87ad-84b57ebe069b tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 23:59:02.835412 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3d07b859-96ae-4296-87ad-84b57ebe069b tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:02.836895 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3d07b859-96ae-4296-87ad-84b57ebe069b tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:02.837955 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3d07b859-96ae-4296-87ad-84b57ebe069b tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:02.839725 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3d07b859-96ae-4296-87ad-84b57ebe069b tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:02.840768 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3d07b859-96ae-4296-87ad-84b57ebe069b tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:02.841964 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3d07b859-96ae-4296-87ad-84b57ebe069b tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:02.880984 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-3d07b859-96ae-4296-87ad-84b57ebe069b tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Getting quotas for project ffc5ce52ae574b82bda143e766bcec80. Resources: {'instances', 'cores', 'ram'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 23:59:02.888517 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-3d07b859-96ae-4296-87ad-84b57ebe069b tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Getting quotas for user 0d81b048f7e64c53894ad9e9ee33f518 and project ffc5ce52ae574b82bda143e766bcec80. Resources: {'instances', 'cores', 'ram'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 23:59:02.907196 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3d07b859-96ae-4296-87ad-84b57ebe069b tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Going to run 1 instances... {{(pid=126975) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 23:59:02.911547 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3d07b859-96ae-4296-87ad-84b57ebe069b tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: f7a64139-3e2f-4855-a0d5-a667621b7ded] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='22a47167-5e04-441a-a504-d76d82afc776',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126975) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 23:59:02.972037 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3d07b859-96ae-4296-87ad-84b57ebe069b tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.008713 Sep 12 23:59:02.972783 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 329/653] 10.222.0.26 () {60 vars in 1147 bytes} [Mon Sep 12 23:59:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 1011 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 12 23:59:02.985298 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0395c0bc-fc8d-403a-a673-41aa20d231c0 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:02.986236 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0395c0bc-fc8d-403a-a673-41aa20d231c0 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: f7a64139-3e2f-4855-a0d5-a667621b7ded] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:03.131194 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0395c0bc-fc8d-403a-a673-41aa20d231c0 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:03.140721 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0395c0bc-fc8d-403a-a673-41aa20d231c0 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded" status: 200 len: 1238 microversion: 2.1 time: 0.159703 Sep 12 23:59:03.143729 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 325/654] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:59:02 2022] GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded => generated 1238 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:59:03.684969 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9c64d5e8-2c06-4d06-b311-072effd60966 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:03.685920 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9c64d5e8-2c06-4d06-b311-072effd60966 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:03.693516 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9c64d5e8-2c06-4d06-b311-072effd60966 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:03.693938 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9c64d5e8-2c06-4d06-b311-072effd60966 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:03.694728 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9c64d5e8-2c06-4d06-b311-072effd60966 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:03.695434 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9c64d5e8-2c06-4d06-b311-072effd60966 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:03.695995 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9c64d5e8-2c06-4d06-b311-072effd60966 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:03.696852 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9c64d5e8-2c06-4d06-b311-072effd60966 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:03.874096 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9c64d5e8-2c06-4d06-b311-072effd60966 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:03.889413 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9c64d5e8-2c06-4d06-b311-072effd60966 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:03.891084 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9c64d5e8-2c06-4d06-b311-072effd60966 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:03.892580 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9c64d5e8-2c06-4d06-b311-072effd60966 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1739 microversion: 2.20 time: 0.212435 Sep 12 23:59:03.893215 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 330/655] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:59:03 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1739 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:59:04.173785 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4dfeb037-88b0-4794-a089-c83d2a055cdc tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:04.175108 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-4dfeb037-88b0-4794-a089-c83d2a055cdc tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: f7a64139-3e2f-4855-a0d5-a667621b7ded] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:04.185147 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4dfeb037-88b0-4794-a089-c83d2a055cdc tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:04.185899 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4dfeb037-88b0-4794-a089-c83d2a055cdc tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:04.186499 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4dfeb037-88b0-4794-a089-c83d2a055cdc tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:04.188059 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4dfeb037-88b0-4794-a089-c83d2a055cdc tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:04.188790 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4dfeb037-88b0-4794-a089-c83d2a055cdc tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:04.189175 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4dfeb037-88b0-4794-a089-c83d2a055cdc tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:04.261012 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4dfeb037-88b0-4794-a089-c83d2a055cdc tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:04.269099 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-4dfeb037-88b0-4794-a089-c83d2a055cdc tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded" status: 200 len: 1242 microversion: 2.1 time: 0.099341 Sep 12 23:59:04.284888 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 326/656] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:59:04 2022] GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded => generated 1242 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:59:04.920215 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9d089142-c930-4421-a679-37305facb53f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:04.920827 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9d089142-c930-4421-a679-37305facb53f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:04.929042 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9d089142-c930-4421-a679-37305facb53f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:04.929546 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9d089142-c930-4421-a679-37305facb53f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:04.930166 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9d089142-c930-4421-a679-37305facb53f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:04.931260 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9d089142-c930-4421-a679-37305facb53f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:04.931876 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9d089142-c930-4421-a679-37305facb53f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:04.932716 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9d089142-c930-4421-a679-37305facb53f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:05.102868 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9d089142-c930-4421-a679-37305facb53f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:05.112468 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9d089142-c930-4421-a679-37305facb53f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:05.113953 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9d089142-c930-4421-a679-37305facb53f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:05.116129 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9d089142-c930-4421-a679-37305facb53f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1739 microversion: 2.20 time: 0.199956 Sep 12 23:59:05.116711 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 331/657] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:59:04 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1739 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:59:05.293348 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f30d4359-f4bd-4d91-a790-3cc39b5fa2d0 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:05.293942 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f30d4359-f4bd-4d91-a790-3cc39b5fa2d0 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: f7a64139-3e2f-4855-a0d5-a667621b7ded] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:05.300915 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f30d4359-f4bd-4d91-a790-3cc39b5fa2d0 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:05.301388 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f30d4359-f4bd-4d91-a790-3cc39b5fa2d0 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:05.301871 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f30d4359-f4bd-4d91-a790-3cc39b5fa2d0 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:05.302529 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f30d4359-f4bd-4d91-a790-3cc39b5fa2d0 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:05.302980 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f30d4359-f4bd-4d91-a790-3cc39b5fa2d0 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:05.303434 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f30d4359-f4bd-4d91-a790-3cc39b5fa2d0 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:05.374097 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f30d4359-f4bd-4d91-a790-3cc39b5fa2d0 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:05.382677 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f30d4359-f4bd-4d91-a790-3cc39b5fa2d0 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded" status: 200 len: 1242 microversion: 2.1 time: 0.093368 Sep 12 23:59:05.383183 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 327/658] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:59:05 2022] GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded => generated 1242 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:59:06.144046 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a421e5a7-a72e-4be0-b1f9-7ea476fc5d4b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:06.144813 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a421e5a7-a72e-4be0-b1f9-7ea476fc5d4b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:06.151957 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a421e5a7-a72e-4be0-b1f9-7ea476fc5d4b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:06.152446 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a421e5a7-a72e-4be0-b1f9-7ea476fc5d4b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:06.152974 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a421e5a7-a72e-4be0-b1f9-7ea476fc5d4b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:06.153630 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a421e5a7-a72e-4be0-b1f9-7ea476fc5d4b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:06.154085 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a421e5a7-a72e-4be0-b1f9-7ea476fc5d4b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:06.154504 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a421e5a7-a72e-4be0-b1f9-7ea476fc5d4b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:06.305994 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a421e5a7-a72e-4be0-b1f9-7ea476fc5d4b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:06.308513 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:59:06.316819 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a421e5a7-a72e-4be0-b1f9-7ea476fc5d4b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:06.318328 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a421e5a7-a72e-4be0-b1f9-7ea476fc5d4b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:06.319547 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a421e5a7-a72e-4be0-b1f9-7ea476fc5d4b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1739 microversion: 2.20 time: 0.179700 Sep 12 23:59:06.320114 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 332/659] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:59:06 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:59:06.406498 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e7a05a0b-0f08-49d3-94f4-d51e04d161d0 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:06.407099 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e7a05a0b-0f08-49d3-94f4-d51e04d161d0 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: f7a64139-3e2f-4855-a0d5-a667621b7ded] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:06.414436 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e7a05a0b-0f08-49d3-94f4-d51e04d161d0 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:06.414934 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e7a05a0b-0f08-49d3-94f4-d51e04d161d0 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:06.415402 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e7a05a0b-0f08-49d3-94f4-d51e04d161d0 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:06.416119 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e7a05a0b-0f08-49d3-94f4-d51e04d161d0 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:06.416576 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e7a05a0b-0f08-49d3-94f4-d51e04d161d0 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:06.416988 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e7a05a0b-0f08-49d3-94f4-d51e04d161d0 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:06.420025 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=100 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:59:06.505283 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e7a05a0b-0f08-49d3-94f4-d51e04d161d0 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:06.519659 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e7a05a0b-0f08-49d3-94f4-d51e04d161d0 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded" status: 200 len: 1290 microversion: 2.1 time: 0.116906 Sep 12 23:59:06.521194 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 328/660] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:59:06 2022] GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded => generated 1290 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:59:07.363690 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0c7a53f7-796b-4ee9-a683-409c7076e063 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:07.366346 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0c7a53f7-796b-4ee9-a683-409c7076e063 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:07.403687 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0c7a53f7-796b-4ee9-a683-409c7076e063 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:07.405619 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0c7a53f7-796b-4ee9-a683-409c7076e063 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:07.412445 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0c7a53f7-796b-4ee9-a683-409c7076e063 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:07.414163 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0c7a53f7-796b-4ee9-a683-409c7076e063 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:07.415604 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0c7a53f7-796b-4ee9-a683-409c7076e063 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:07.421326 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0c7a53f7-796b-4ee9-a683-409c7076e063 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:07.548756 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f4e19656-73ca-4e9e-b700-92d5f4742097 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:07.549890 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f4e19656-73ca-4e9e-b700-92d5f4742097 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: f7a64139-3e2f-4855-a0d5-a667621b7ded] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:07.565937 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f4e19656-73ca-4e9e-b700-92d5f4742097 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:07.566837 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f4e19656-73ca-4e9e-b700-92d5f4742097 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:07.567655 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f4e19656-73ca-4e9e-b700-92d5f4742097 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:07.568977 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f4e19656-73ca-4e9e-b700-92d5f4742097 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:07.569814 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f4e19656-73ca-4e9e-b700-92d5f4742097 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:07.570784 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f4e19656-73ca-4e9e-b700-92d5f4742097 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:07.650944 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0c7a53f7-796b-4ee9-a683-409c7076e063 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:07.661005 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0c7a53f7-796b-4ee9-a683-409c7076e063 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:07.662591 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0c7a53f7-796b-4ee9-a683-409c7076e063 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:07.664041 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0c7a53f7-796b-4ee9-a683-409c7076e063 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1721 microversion: 2.20 time: 0.320258 Sep 12 23:59:07.664780 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 333/661] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:59:07 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1721 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:59:07.689259 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f4e19656-73ca-4e9e-b700-92d5f4742097 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:07.705276 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f4e19656-73ca-4e9e-b700-92d5f4742097 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded" status: 200 len: 1296 microversion: 2.1 time: 0.161907 Sep 12 23:59:07.706366 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 329/662] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:59:07 2022] GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded => generated 1296 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:59:08.694589 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d099cac3-f809-4446-8b1d-0bb90cbce168 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:08.695769 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d099cac3-f809-4446-8b1d-0bb90cbce168 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:08.701639 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:59:08.705809 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d099cac3-f809-4446-8b1d-0bb90cbce168 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:08.706291 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d099cac3-f809-4446-8b1d-0bb90cbce168 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:08.706722 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d099cac3-f809-4446-8b1d-0bb90cbce168 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:08.707469 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d099cac3-f809-4446-8b1d-0bb90cbce168 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:08.707975 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d099cac3-f809-4446-8b1d-0bb90cbce168 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:08.708393 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d099cac3-f809-4446-8b1d-0bb90cbce168 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:08.743284 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8c3a1570-048b-45d9-911e-7a602374c453 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:08.744648 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-8c3a1570-048b-45d9-911e-7a602374c453 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: f7a64139-3e2f-4855-a0d5-a667621b7ded] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:08.752420 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8c3a1570-048b-45d9-911e-7a602374c453 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:08.753213 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8c3a1570-048b-45d9-911e-7a602374c453 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:08.753666 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8c3a1570-048b-45d9-911e-7a602374c453 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:08.755648 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8c3a1570-048b-45d9-911e-7a602374c453 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:08.757075 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8c3a1570-048b-45d9-911e-7a602374c453 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:08.757857 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8c3a1570-048b-45d9-911e-7a602374c453 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:08.899214 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d099cac3-f809-4446-8b1d-0bb90cbce168 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:08.908417 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d099cac3-f809-4446-8b1d-0bb90cbce168 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:08.910931 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d099cac3-f809-4446-8b1d-0bb90cbce168 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:08.912159 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d099cac3-f809-4446-8b1d-0bb90cbce168 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1721 microversion: 2.20 time: 0.225667 Sep 12 23:59:08.912725 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 334/663] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:59:08 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1721 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 23:59:08.940369 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8c3a1570-048b-45d9-911e-7a602374c453 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:08.950415 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-8c3a1570-048b-45d9-911e-7a602374c453 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded" status: 200 len: 1364 microversion: 2.1 time: 0.210909 Sep 12 23:59:08.950985 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 330/664] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:59:08 2022] GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded => generated 1364 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:59:09.941105 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-62482e66-241f-4f47-b0e4-0a62a8c0cb52 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:09.942424 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-62482e66-241f-4f47-b0e4-0a62a8c0cb52 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:09.957129 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-62482e66-241f-4f47-b0e4-0a62a8c0cb52 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:09.957617 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-62482e66-241f-4f47-b0e4-0a62a8c0cb52 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:09.958050 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-62482e66-241f-4f47-b0e4-0a62a8c0cb52 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:09.958758 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-62482e66-241f-4f47-b0e4-0a62a8c0cb52 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:09.959205 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-62482e66-241f-4f47-b0e4-0a62a8c0cb52 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:09.959650 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-62482e66-241f-4f47-b0e4-0a62a8c0cb52 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:09.977021 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e96d0f5d-7f73-4fac-808b-9e57d1ff980c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:09.978527 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e96d0f5d-7f73-4fac-808b-9e57d1ff980c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: f7a64139-3e2f-4855-a0d5-a667621b7ded] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:09.995721 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e96d0f5d-7f73-4fac-808b-9e57d1ff980c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:09.997303 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e96d0f5d-7f73-4fac-808b-9e57d1ff980c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:09.998929 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e96d0f5d-7f73-4fac-808b-9e57d1ff980c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:10.003158 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e96d0f5d-7f73-4fac-808b-9e57d1ff980c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:10.004265 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e96d0f5d-7f73-4fac-808b-9e57d1ff980c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:10.005500 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e96d0f5d-7f73-4fac-808b-9e57d1ff980c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:10.362627 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-62482e66-241f-4f47-b0e4-0a62a8c0cb52 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:10.372197 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-62482e66-241f-4f47-b0e4-0a62a8c0cb52 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:10.374270 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-62482e66-241f-4f47-b0e4-0a62a8c0cb52 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:10.375759 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-62482e66-241f-4f47-b0e4-0a62a8c0cb52 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1721 microversion: 2.20 time: 0.438951 Sep 12 23:59:10.379339 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e96d0f5d-7f73-4fac-808b-9e57d1ff980c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:10.403714 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 335/665] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:59:09 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1721 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:59:10.405209 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e96d0f5d-7f73-4fac-808b-9e57d1ff980c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded" status: 200 len: 1364 microversion: 2.1 time: 0.417991 Sep 12 23:59:10.406005 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 331/666] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:59:09 2022] GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded => generated 1364 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:59:10.606840 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-b3ec4cd2-6c08-45b4-a30b-7a70b61b6552 req-8b13ab54-dce2-48be-829d-94b99001308b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3088bc31-f3ff-476d-a0ad-9f10186b442f", "name": "network-vif-unplugged", "status": "completed", "tag": "8a984b84-cffe-442a-8574-f76c08213db0"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:59:10.623786 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-b3ec4cd2-6c08-45b4-a30b-7a70b61b6552 req-8b13ab54-dce2-48be-829d-94b99001308b service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:10.625011 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-b3ec4cd2-6c08-45b4-a30b-7a70b61b6552 req-8b13ab54-dce2-48be-829d-94b99001308b service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:10.625573 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-b3ec4cd2-6c08-45b4-a30b-7a70b61b6552 req-8b13ab54-dce2-48be-829d-94b99001308b service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:10.640263 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.compute.server_external_events [req-b3ec4cd2-6c08-45b4-a30b-7a70b61b6552 req-8b13ab54-dce2-48be-829d-94b99001308b service nova] Unable to find a host for instance 3088bc31-f3ff-476d-a0ad-9f10186b442f. Dropping event network-vif-unplugged {{(pid=126975) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 12 23:59:10.641328 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-b3ec4cd2-6c08-45b4-a30b-7a70b61b6552 req-8b13ab54-dce2-48be-829d-94b99001308b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.236457 Sep 12 23:59:10.642429 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 336/667] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 238 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 12 23:59:10.867039 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-c01b6e82-649c-4ed6-8cc8-4f194787d0e5 req-c58914c8-1658-4cab-98dd-826648392dc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7a64139-3e2f-4855-a0d5-a667621b7ded", "tag": "179e43ce-b6df-4eaa-9bf7-f66d5c59cb2f"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:59:10.886519 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-c01b6e82-649c-4ed6-8cc8-4f194787d0e5 req-c58914c8-1658-4cab-98dd-826648392dc4 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:10.886917 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-c01b6e82-649c-4ed6-8cc8-4f194787d0e5 req-c58914c8-1658-4cab-98dd-826648392dc4 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:10.887380 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-c01b6e82-649c-4ed6-8cc8-4f194787d0e5 req-c58914c8-1658-4cab-98dd-826648392dc4 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:10.908273 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-c01b6e82-649c-4ed6-8cc8-4f194787d0e5 req-c58914c8-1658-4cab-98dd-826648392dc4 service nova] Creating event network-changed:179e43ce-b6df-4eaa-9bf7-f66d5c59cb2f for instance f7a64139-3e2f-4855-a0d5-a667621b7ded on hv-cinder-82002 Sep 12 23:59:10.914494 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-c01b6e82-649c-4ed6-8cc8-4f194787d0e5 req-c58914c8-1658-4cab-98dd-826648392dc4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053206 Sep 12 23:59:10.915538 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 332/668] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:59:11.423595 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-220f5daf-2ae6-40e7-8345-1288dc807349 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:11.424929 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-220f5daf-2ae6-40e7-8345-1288dc807349 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:11.428112 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-32db8a2d-1574-4fdc-aa0e-74c24392ff04 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:11.428819 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-32db8a2d-1574-4fdc-aa0e-74c24392ff04 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: f7a64139-3e2f-4855-a0d5-a667621b7ded] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:11.434460 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-220f5daf-2ae6-40e7-8345-1288dc807349 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:11.435357 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-220f5daf-2ae6-40e7-8345-1288dc807349 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:11.436707 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-220f5daf-2ae6-40e7-8345-1288dc807349 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:11.437693 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-220f5daf-2ae6-40e7-8345-1288dc807349 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:11.438565 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-220f5daf-2ae6-40e7-8345-1288dc807349 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:11.438855 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-32db8a2d-1574-4fdc-aa0e-74c24392ff04 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:11.438995 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-220f5daf-2ae6-40e7-8345-1288dc807349 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:11.439366 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-32db8a2d-1574-4fdc-aa0e-74c24392ff04 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:11.440015 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-32db8a2d-1574-4fdc-aa0e-74c24392ff04 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:11.440718 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-32db8a2d-1574-4fdc-aa0e-74c24392ff04 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:11.441197 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-32db8a2d-1574-4fdc-aa0e-74c24392ff04 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:11.441573 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-32db8a2d-1574-4fdc-aa0e-74c24392ff04 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:11.667093 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-32db8a2d-1574-4fdc-aa0e-74c24392ff04 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:11.676833 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-32db8a2d-1574-4fdc-aa0e-74c24392ff04 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded" status: 200 len: 1364 microversion: 2.1 time: 0.252989 Sep 12 23:59:11.677570 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 333/669] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:59:11 2022] GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded => generated 1364 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:59:11.682091 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-220f5daf-2ae6-40e7-8345-1288dc807349 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:11.691017 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-220f5daf-2ae6-40e7-8345-1288dc807349 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:11.692592 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-220f5daf-2ae6-40e7-8345-1288dc807349 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:11.693780 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-220f5daf-2ae6-40e7-8345-1288dc807349 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1664 microversion: 2.20 time: 0.276199 Sep 12 23:59:11.694343 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 337/670] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:59:11 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1664 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:59:11.718863 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-513a17a8-28a4-4f74-af1a-ef3e9115055d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e408fbe2-1127-4958-a899-40682fb18cc8"}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:59:11.721355 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-513a17a8-28a4-4f74-af1a-ef3e9115055d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:11.727538 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-513a17a8-28a4-4f74-af1a-ef3e9115055d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:11.728021 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-513a17a8-28a4-4f74-af1a-ef3e9115055d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:11.728478 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-513a17a8-28a4-4f74-af1a-ef3e9115055d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:11.729145 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-513a17a8-28a4-4f74-af1a-ef3e9115055d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:11.729594 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-513a17a8-28a4-4f74-af1a-ef3e9115055d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:11.730001 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-513a17a8-28a4-4f74-af1a-ef3e9115055d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:12.046511 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-513a17a8-28a4-4f74-af1a-ef3e9115055d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "POST /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.331294 Sep 12 23:59:12.054162 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 334/671] 10.222.0.26 () {62 vars in 1364 bytes} [Mon Sep 12 23:59:11 2022] POST /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f/os-volume_attachments => generated 188 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 12 23:59:12.202834 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0eb32f10-82d4-49e2-9ff7-863cc2bf3b92 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:12.203359 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0eb32f10-82d4-49e2-9ff7-863cc2bf3b92 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:12.209745 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0eb32f10-82d4-49e2-9ff7-863cc2bf3b92 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:12.210210 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0eb32f10-82d4-49e2-9ff7-863cc2bf3b92 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:12.210642 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0eb32f10-82d4-49e2-9ff7-863cc2bf3b92 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:12.211440 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0eb32f10-82d4-49e2-9ff7-863cc2bf3b92 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:12.211952 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0eb32f10-82d4-49e2-9ff7-863cc2bf3b92 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:12.212293 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0eb32f10-82d4-49e2-9ff7-863cc2bf3b92 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:12.498916 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0eb32f10-82d4-49e2-9ff7-863cc2bf3b92 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f/os-volume_attachments/e408fbe2-1127-4958-a899-40682fb18cc8" status: 202 len: 0 microversion: 2.20 time: 0.300360 Sep 12 23:59:12.500313 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 338/672] 10.222.0.26 () {60 vars in 1457 bytes} [Mon Sep 12 23:59:12 2022] DELETE /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f/os-volume_attachments/e408fbe2-1127-4958-a899-40682fb18cc8 => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 12 23:59:12.569751 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1eee2420-d751-4f66-99eb-c75bdb564c97 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:59:12.570360 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1eee2420-d751-4f66-99eb-c75bdb564c97 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:12.578529 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1eee2420-d751-4f66-99eb-c75bdb564c97 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:12.579110 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1eee2420-d751-4f66-99eb-c75bdb564c97 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:12.579976 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1eee2420-d751-4f66-99eb-c75bdb564c97 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:12.581146 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1eee2420-d751-4f66-99eb-c75bdb564c97 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:12.581611 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1eee2420-d751-4f66-99eb-c75bdb564c97 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:12.582151 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1eee2420-d751-4f66-99eb-c75bdb564c97 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:12.699327 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-35f65ca3-7f6a-45df-a948-b79d5b2a96c2 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:12.700254 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-35f65ca3-7f6a-45df-a948-b79d5b2a96c2 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: f7a64139-3e2f-4855-a0d5-a667621b7ded] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:12.715865 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-35f65ca3-7f6a-45df-a948-b79d5b2a96c2 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:12.716819 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-35f65ca3-7f6a-45df-a948-b79d5b2a96c2 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:12.717544 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-35f65ca3-7f6a-45df-a948-b79d5b2a96c2 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:12.718681 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-35f65ca3-7f6a-45df-a948-b79d5b2a96c2 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:12.719398 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-35f65ca3-7f6a-45df-a948-b79d5b2a96c2 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:12.720300 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-35f65ca3-7f6a-45df-a948-b79d5b2a96c2 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:12.781426 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1eee2420-d751-4f66-99eb-c75bdb564c97 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=126976) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 12 23:59:12.856668 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell0:SELECT=2 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:59:12.875385 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1eee2420-d751-4f66-99eb-c75bdb564c97 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "POST /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f/action" status: 202 len: 0 microversion: 2.20 time: 0.310297 Sep 12 23:59:12.876065 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 335/673] 10.222.0.26 () {62 vars in 1319 bytes} [Mon Sep 12 23:59:12 2022] POST /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f/action => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 12 23:59:12.884409 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-36a994d4-3e1d-48fd-a8c1-52d3960a772a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:12.885021 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-36a994d4-3e1d-48fd-a8c1-52d3960a772a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:12.892221 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-36a994d4-3e1d-48fd-a8c1-52d3960a772a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:12.892985 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-36a994d4-3e1d-48fd-a8c1-52d3960a772a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:12.893436 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-36a994d4-3e1d-48fd-a8c1-52d3960a772a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:12.894163 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-36a994d4-3e1d-48fd-a8c1-52d3960a772a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:12.894607 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-36a994d4-3e1d-48fd-a8c1-52d3960a772a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:12.895467 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-36a994d4-3e1d-48fd-a8c1-52d3960a772a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:12.901174 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell0:SELECT=6 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:59:13.138211 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell0:SELECT=6 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:59:13.333407 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-35f65ca3-7f6a-45df-a948-b79d5b2a96c2 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:13.344804 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-35f65ca3-7f6a-45df-a948-b79d5b2a96c2 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded" status: 200 len: 1364 microversion: 2.1 time: 0.649409 Sep 12 23:59:13.345606 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 339/674] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:59:12 2022] GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded => generated 1364 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:59:13.431171 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-36a994d4-3e1d-48fd-a8c1-52d3960a772a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:13.448135 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-36a994d4-3e1d-48fd-a8c1-52d3960a772a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:13.449704 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-36a994d4-3e1d-48fd-a8c1-52d3960a772a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:13.450909 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-36a994d4-3e1d-48fd-a8c1-52d3960a772a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1672 microversion: 2.20 time: 0.570562 Sep 12 23:59:13.451493 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 336/675] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:59:12 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1672 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 23:59:14.370617 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-03f04700-bec4-4b80-802a-4966d92d163f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:14.371592 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-03f04700-bec4-4b80-802a-4966d92d163f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: f7a64139-3e2f-4855-a0d5-a667621b7ded] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:14.378203 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-03f04700-bec4-4b80-802a-4966d92d163f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:14.379325 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-03f04700-bec4-4b80-802a-4966d92d163f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:14.380123 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-03f04700-bec4-4b80-802a-4966d92d163f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:14.381210 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-03f04700-bec4-4b80-802a-4966d92d163f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:14.381869 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-03f04700-bec4-4b80-802a-4966d92d163f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:14.382488 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-03f04700-bec4-4b80-802a-4966d92d163f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:14.477609 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-293d0921-184e-44e2-829b-202c11709236 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:14.478326 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-293d0921-184e-44e2-829b-202c11709236 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:14.484848 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-293d0921-184e-44e2-829b-202c11709236 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:14.485764 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-293d0921-184e-44e2-829b-202c11709236 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:14.486391 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-293d0921-184e-44e2-829b-202c11709236 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:14.487343 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-293d0921-184e-44e2-829b-202c11709236 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:14.487940 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-293d0921-184e-44e2-829b-202c11709236 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:14.488522 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-293d0921-184e-44e2-829b-202c11709236 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:14.619049 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-03f04700-bec4-4b80-802a-4966d92d163f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:14.628274 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-03f04700-bec4-4b80-802a-4966d92d163f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded" status: 200 len: 1364 microversion: 2.1 time: 0.262891 Sep 12 23:59:14.645545 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 340/676] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:59:14 2022] GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded => generated 1364 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:59:14.690711 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-293d0921-184e-44e2-829b-202c11709236 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:14.700699 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-293d0921-184e-44e2-829b-202c11709236 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:14.702148 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-293d0921-184e-44e2-829b-202c11709236 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:14.703365 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-293d0921-184e-44e2-829b-202c11709236 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1674 microversion: 2.20 time: 0.229694 Sep 12 23:59:14.704343 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 337/677] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:59:14 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1674 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:59:15.652927 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a3d6fd61-c62a-48ba-8c9b-8d7bbab411f6 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:15.653524 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a3d6fd61-c62a-48ba-8c9b-8d7bbab411f6 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: f7a64139-3e2f-4855-a0d5-a667621b7ded] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:15.660312 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a3d6fd61-c62a-48ba-8c9b-8d7bbab411f6 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:15.660860 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a3d6fd61-c62a-48ba-8c9b-8d7bbab411f6 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:15.661204 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a3d6fd61-c62a-48ba-8c9b-8d7bbab411f6 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:15.661993 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a3d6fd61-c62a-48ba-8c9b-8d7bbab411f6 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:15.662372 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a3d6fd61-c62a-48ba-8c9b-8d7bbab411f6 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:15.662785 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a3d6fd61-c62a-48ba-8c9b-8d7bbab411f6 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:15.731446 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-97243cda-7247-404a-87ce-3ab1e44bada2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:15.732226 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-97243cda-7247-404a-87ce-3ab1e44bada2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:15.742573 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-97243cda-7247-404a-87ce-3ab1e44bada2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:15.743085 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-97243cda-7247-404a-87ce-3ab1e44bada2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:15.743567 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-97243cda-7247-404a-87ce-3ab1e44bada2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:15.744486 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-97243cda-7247-404a-87ce-3ab1e44bada2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:15.745098 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-97243cda-7247-404a-87ce-3ab1e44bada2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:15.745851 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-97243cda-7247-404a-87ce-3ab1e44bada2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:15.888312 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a3d6fd61-c62a-48ba-8c9b-8d7bbab411f6 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:15.898878 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a3d6fd61-c62a-48ba-8c9b-8d7bbab411f6 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded" status: 200 len: 1364 microversion: 2.1 time: 0.249619 Sep 12 23:59:15.911509 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 341/678] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:59:15 2022] GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded => generated 1364 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:59:16.006018 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-97243cda-7247-404a-87ce-3ab1e44bada2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:16.016709 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-97243cda-7247-404a-87ce-3ab1e44bada2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:16.018052 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-97243cda-7247-404a-87ce-3ab1e44bada2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:16.020232 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-97243cda-7247-404a-87ce-3ab1e44bada2 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1730 microversion: 2.20 time: 0.292997 Sep 12 23:59:16.033194 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 338/679] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:59:15 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1730 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 12 23:59:16.090518 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-eed83142-870c-40a1-83a4-7451e42cc420 req-bf3adba0-18a9-454c-9464-7d0bdf6d8a5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7a64139-3e2f-4855-a0d5-a667621b7ded", "name": "network-vif-plugged", "status": "completed", "tag": "179e43ce-b6df-4eaa-9bf7-f66d5c59cb2f"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:59:16.121764 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-eed83142-870c-40a1-83a4-7451e42cc420 req-bf3adba0-18a9-454c-9464-7d0bdf6d8a5c service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:16.122567 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-eed83142-870c-40a1-83a4-7451e42cc420 req-bf3adba0-18a9-454c-9464-7d0bdf6d8a5c service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:16.123534 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-eed83142-870c-40a1-83a4-7451e42cc420 req-bf3adba0-18a9-454c-9464-7d0bdf6d8a5c service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:16.138448 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-eed83142-870c-40a1-83a4-7451e42cc420 req-bf3adba0-18a9-454c-9464-7d0bdf6d8a5c service nova] Creating event network-vif-plugged:179e43ce-b6df-4eaa-9bf7-f66d5c59cb2f for instance f7a64139-3e2f-4855-a0d5-a667621b7ded on hv-cinder-82002 Sep 12 23:59:16.146595 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-eed83142-870c-40a1-83a4-7451e42cc420 req-bf3adba0-18a9-454c-9464-7d0bdf6d8a5c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083369 Sep 12 23:59:16.147509 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 342/680] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:59:16.924443 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-40575e13-b311-46f3-b648-d58d9e478002 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:16.925763 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-40575e13-b311-46f3-b648-d58d9e478002 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: f7a64139-3e2f-4855-a0d5-a667621b7ded] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:16.933218 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-40575e13-b311-46f3-b648-d58d9e478002 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:16.934194 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-40575e13-b311-46f3-b648-d58d9e478002 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:16.934959 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-40575e13-b311-46f3-b648-d58d9e478002 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:16.935942 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-40575e13-b311-46f3-b648-d58d9e478002 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:16.936697 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-40575e13-b311-46f3-b648-d58d9e478002 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:16.937307 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-40575e13-b311-46f3-b648-d58d9e478002 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:17.048254 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-56e347a8-c7c4-4a19-a7a7-2a104b06d5a1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:17.049006 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-56e347a8-c7c4-4a19-a7a7-2a104b06d5a1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:17.069408 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-56e347a8-c7c4-4a19-a7a7-2a104b06d5a1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:17.069901 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-56e347a8-c7c4-4a19-a7a7-2a104b06d5a1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:17.070335 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-56e347a8-c7c4-4a19-a7a7-2a104b06d5a1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:17.071056 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-56e347a8-c7c4-4a19-a7a7-2a104b06d5a1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:17.072086 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-56e347a8-c7c4-4a19-a7a7-2a104b06d5a1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:17.072545 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-56e347a8-c7c4-4a19-a7a7-2a104b06d5a1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:17.228607 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-40575e13-b311-46f3-b648-d58d9e478002 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:17.242737 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-40575e13-b311-46f3-b648-d58d9e478002 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded" status: 200 len: 1364 microversion: 2.1 time: 0.322944 Sep 12 23:59:17.244085 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 339/681] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:59:16 2022] GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded => generated 1364 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:59:17.340561 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-56e347a8-c7c4-4a19-a7a7-2a104b06d5a1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:17.349712 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-56e347a8-c7c4-4a19-a7a7-2a104b06d5a1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:17.351551 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-56e347a8-c7c4-4a19-a7a7-2a104b06d5a1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:17.352971 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-56e347a8-c7c4-4a19-a7a7-2a104b06d5a1 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1730 microversion: 2.20 time: 0.310073 Sep 12 23:59:17.353728 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 343/682] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:59:17 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1730 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:59:18.267710 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e35b9b4f-7cfc-4440-852f-91ef2061844c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:18.269123 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e35b9b4f-7cfc-4440-852f-91ef2061844c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: f7a64139-3e2f-4855-a0d5-a667621b7ded] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:18.277559 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e35b9b4f-7cfc-4440-852f-91ef2061844c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:18.278208 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e35b9b4f-7cfc-4440-852f-91ef2061844c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:18.278677 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e35b9b4f-7cfc-4440-852f-91ef2061844c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:18.279482 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e35b9b4f-7cfc-4440-852f-91ef2061844c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:18.280203 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e35b9b4f-7cfc-4440-852f-91ef2061844c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:18.283643 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e35b9b4f-7cfc-4440-852f-91ef2061844c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:18.379489 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-3df6321c-c4d3-41e2-ba6c-632e73d3afef tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:18.381488 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-3df6321c-c4d3-41e2-ba6c-632e73d3afef tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:18.396224 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3df6321c-c4d3-41e2-ba6c-632e73d3afef tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:18.399873 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3df6321c-c4d3-41e2-ba6c-632e73d3afef tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:18.400764 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3df6321c-c4d3-41e2-ba6c-632e73d3afef tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:18.401927 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3df6321c-c4d3-41e2-ba6c-632e73d3afef tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:18.402645 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3df6321c-c4d3-41e2-ba6c-632e73d3afef tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:18.403350 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-3df6321c-c4d3-41e2-ba6c-632e73d3afef tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:18.549903 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e35b9b4f-7cfc-4440-852f-91ef2061844c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:18.570496 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e35b9b4f-7cfc-4440-852f-91ef2061844c tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded" status: 200 len: 1364 microversion: 2.1 time: 0.307390 Sep 12 23:59:18.595364 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 340/683] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:59:18 2022] GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded => generated 1364 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:59:18.688214 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3df6321c-c4d3-41e2-ba6c-632e73d3afef tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:18.700512 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3df6321c-c4d3-41e2-ba6c-632e73d3afef tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:18.702290 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-3df6321c-c4d3-41e2-ba6c-632e73d3afef tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:18.704063 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-3df6321c-c4d3-41e2-ba6c-632e73d3afef tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1730 microversion: 2.20 time: 0.329307 Sep 12 23:59:18.705316 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 344/684] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:59:18 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1730 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:59:19.622563 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2be37f1d-702f-4586-99b0-1863376f2a87 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:19.623257 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2be37f1d-702f-4586-99b0-1863376f2a87 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: f7a64139-3e2f-4855-a0d5-a667621b7ded] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:19.630623 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2be37f1d-702f-4586-99b0-1863376f2a87 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:19.631234 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2be37f1d-702f-4586-99b0-1863376f2a87 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:19.631676 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2be37f1d-702f-4586-99b0-1863376f2a87 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:19.632394 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2be37f1d-702f-4586-99b0-1863376f2a87 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:19.632853 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2be37f1d-702f-4586-99b0-1863376f2a87 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:19.634097 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2be37f1d-702f-4586-99b0-1863376f2a87 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:19.758349 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f69b317b-8610-4fb6-afb0-ec40c3f12f52 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:19.762727 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f69b317b-8610-4fb6-afb0-ec40c3f12f52 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:19.774852 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f69b317b-8610-4fb6-afb0-ec40c3f12f52 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:19.775654 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f69b317b-8610-4fb6-afb0-ec40c3f12f52 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:19.776336 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f69b317b-8610-4fb6-afb0-ec40c3f12f52 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:19.777547 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f69b317b-8610-4fb6-afb0-ec40c3f12f52 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:19.778529 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f69b317b-8610-4fb6-afb0-ec40c3f12f52 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:19.779161 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f69b317b-8610-4fb6-afb0-ec40c3f12f52 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:19.822796 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2be37f1d-702f-4586-99b0-1863376f2a87 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:19.825877 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:59:19.836365 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2be37f1d-702f-4586-99b0-1863376f2a87 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded" status: 200 len: 1364 microversion: 2.1 time: 0.217791 Sep 12 23:59:19.851991 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 341/685] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:59:19 2022] GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded => generated 1364 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:59:20.071784 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f69b317b-8610-4fb6-afb0-ec40c3f12f52 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:20.089366 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f69b317b-8610-4fb6-afb0-ec40c3f12f52 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:20.093144 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f69b317b-8610-4fb6-afb0-ec40c3f12f52 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:20.096076 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f69b317b-8610-4fb6-afb0-ec40c3f12f52 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1730 microversion: 2.20 time: 0.344668 Sep 12 23:59:20.097940 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 345/686] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:59:19 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1730 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:59:20.860933 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ca3ebc2b-0b15-42ca-aecf-fc60d06fbe16 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:20.861567 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ca3ebc2b-0b15-42ca-aecf-fc60d06fbe16 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: f7a64139-3e2f-4855-a0d5-a667621b7ded] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:20.869842 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ca3ebc2b-0b15-42ca-aecf-fc60d06fbe16 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:20.870343 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ca3ebc2b-0b15-42ca-aecf-fc60d06fbe16 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:20.870781 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ca3ebc2b-0b15-42ca-aecf-fc60d06fbe16 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:20.871538 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ca3ebc2b-0b15-42ca-aecf-fc60d06fbe16 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:20.872036 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ca3ebc2b-0b15-42ca-aecf-fc60d06fbe16 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:20.872505 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ca3ebc2b-0b15-42ca-aecf-fc60d06fbe16 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:21.049349 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ca3ebc2b-0b15-42ca-aecf-fc60d06fbe16 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:21.064483 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ca3ebc2b-0b15-42ca-aecf-fc60d06fbe16 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded" status: 200 len: 1364 microversion: 2.1 time: 0.207924 Sep 12 23:59:21.065090 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 342/687] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:59:20 2022] GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded => generated 1364 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:59:21.129037 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b76e8829-e325-409f-b864-7e66bf1b9b9c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:21.130535 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b76e8829-e325-409f-b864-7e66bf1b9b9c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:21.138215 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b76e8829-e325-409f-b864-7e66bf1b9b9c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:21.138798 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b76e8829-e325-409f-b864-7e66bf1b9b9c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:21.139348 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b76e8829-e325-409f-b864-7e66bf1b9b9c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:21.140155 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b76e8829-e325-409f-b864-7e66bf1b9b9c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:21.140673 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b76e8829-e325-409f-b864-7e66bf1b9b9c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:21.141193 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b76e8829-e325-409f-b864-7e66bf1b9b9c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:21.343841 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b76e8829-e325-409f-b864-7e66bf1b9b9c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:21.353256 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b76e8829-e325-409f-b864-7e66bf1b9b9c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:21.354698 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b76e8829-e325-409f-b864-7e66bf1b9b9c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:21.356055 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b76e8829-e325-409f-b864-7e66bf1b9b9c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1730 microversion: 2.20 time: 0.232269 Sep 12 23:59:21.356615 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 346/688] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:59:21 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1730 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:59:22.090992 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1deb8d03-05d4-4411-be0d-656b0a05469d tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:22.092630 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1deb8d03-05d4-4411-be0d-656b0a05469d tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: f7a64139-3e2f-4855-a0d5-a667621b7ded] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:22.103294 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1deb8d03-05d4-4411-be0d-656b0a05469d tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:22.104317 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1deb8d03-05d4-4411-be0d-656b0a05469d tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:22.104923 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1deb8d03-05d4-4411-be0d-656b0a05469d tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:22.105655 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1deb8d03-05d4-4411-be0d-656b0a05469d tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:22.106140 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1deb8d03-05d4-4411-be0d-656b0a05469d tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:22.106652 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1deb8d03-05d4-4411-be0d-656b0a05469d tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:22.291108 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-1deb8d03-05d4-4411-be0d-656b0a05469d tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:22.308804 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1deb8d03-05d4-4411-be0d-656b0a05469d tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded" status: 200 len: 1364 microversion: 2.1 time: 0.221931 Sep 12 23:59:22.309982 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 343/689] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:59:22 2022] GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded => generated 1364 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:59:22.388256 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-025a3fff-1db7-4119-800c-e3259d98688f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:22.389509 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-025a3fff-1db7-4119-800c-e3259d98688f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:22.397146 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-025a3fff-1db7-4119-800c-e3259d98688f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:22.398001 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-025a3fff-1db7-4119-800c-e3259d98688f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:22.398471 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-025a3fff-1db7-4119-800c-e3259d98688f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:22.399235 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-025a3fff-1db7-4119-800c-e3259d98688f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:22.399697 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-025a3fff-1db7-4119-800c-e3259d98688f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:22.400124 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-025a3fff-1db7-4119-800c-e3259d98688f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:22.589010 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-025a3fff-1db7-4119-800c-e3259d98688f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:22.598546 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-025a3fff-1db7-4119-800c-e3259d98688f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:22.600271 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-025a3fff-1db7-4119-800c-e3259d98688f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:22.601485 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-025a3fff-1db7-4119-800c-e3259d98688f tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1730 microversion: 2.20 time: 0.219618 Sep 12 23:59:22.602243 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 347/690] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:59:22 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1730 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:59:23.333982 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-00f4edd9-83b4-45a7-a1f1-9abfc4f36f20 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:23.334762 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-00f4edd9-83b4-45a7-a1f1-9abfc4f36f20 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: f7a64139-3e2f-4855-a0d5-a667621b7ded] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:23.342988 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-00f4edd9-83b4-45a7-a1f1-9abfc4f36f20 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:23.343540 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-00f4edd9-83b4-45a7-a1f1-9abfc4f36f20 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:23.343980 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-00f4edd9-83b4-45a7-a1f1-9abfc4f36f20 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:23.344818 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-00f4edd9-83b4-45a7-a1f1-9abfc4f36f20 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:23.345418 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-00f4edd9-83b4-45a7-a1f1-9abfc4f36f20 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:23.345797 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-00f4edd9-83b4-45a7-a1f1-9abfc4f36f20 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:23.497477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-00f4edd9-83b4-45a7-a1f1-9abfc4f36f20 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:23.505843 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-00f4edd9-83b4-45a7-a1f1-9abfc4f36f20 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded" status: 200 len: 1364 microversion: 2.1 time: 0.175852 Sep 12 23:59:23.506439 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 344/691] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:59:23 2022] GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:59:23.629182 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f93214ac-1af0-40bb-9166-0c8d16655adb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:23.629739 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f93214ac-1af0-40bb-9166-0c8d16655adb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:23.636564 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f93214ac-1af0-40bb-9166-0c8d16655adb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:23.637046 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f93214ac-1af0-40bb-9166-0c8d16655adb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:23.637476 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f93214ac-1af0-40bb-9166-0c8d16655adb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:23.638176 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f93214ac-1af0-40bb-9166-0c8d16655adb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:23.638619 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f93214ac-1af0-40bb-9166-0c8d16655adb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:23.639052 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f93214ac-1af0-40bb-9166-0c8d16655adb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:23.643816 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:59:23.795347 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f93214ac-1af0-40bb-9166-0c8d16655adb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:23.805168 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f93214ac-1af0-40bb-9166-0c8d16655adb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:23.807086 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f93214ac-1af0-40bb-9166-0c8d16655adb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:23.808697 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f93214ac-1af0-40bb-9166-0c8d16655adb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1730 microversion: 2.20 time: 0.183632 Sep 12 23:59:23.809923 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 348/692] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:59:23 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1730 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:59:24.536912 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1027a311-f5c0-4559-9b54-b70dbd6740ae tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:24.539776 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1027a311-f5c0-4559-9b54-b70dbd6740ae tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: f7a64139-3e2f-4855-a0d5-a667621b7ded] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:24.548829 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1027a311-f5c0-4559-9b54-b70dbd6740ae tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:24.549795 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1027a311-f5c0-4559-9b54-b70dbd6740ae tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:24.550391 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1027a311-f5c0-4559-9b54-b70dbd6740ae tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:24.551300 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1027a311-f5c0-4559-9b54-b70dbd6740ae tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:24.551925 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1027a311-f5c0-4559-9b54-b70dbd6740ae tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:24.552730 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1027a311-f5c0-4559-9b54-b70dbd6740ae tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:24.712439 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-1027a311-f5c0-4559-9b54-b70dbd6740ae tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:24.720892 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1027a311-f5c0-4559-9b54-b70dbd6740ae tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded" status: 200 len: 1364 microversion: 2.1 time: 0.194802 Sep 12 23:59:24.721615 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 345/693] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:59:24 2022] GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded => generated 1364 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:59:24.843300 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-01d89be8-2639-4964-bf58-b2306455b243 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:24.844721 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-01d89be8-2639-4964-bf58-b2306455b243 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:24.856325 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-01d89be8-2639-4964-bf58-b2306455b243 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:24.857106 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-01d89be8-2639-4964-bf58-b2306455b243 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:24.857726 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-01d89be8-2639-4964-bf58-b2306455b243 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:24.858897 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-01d89be8-2639-4964-bf58-b2306455b243 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:24.859656 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-01d89be8-2639-4964-bf58-b2306455b243 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:24.860334 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-01d89be8-2639-4964-bf58-b2306455b243 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:25.079398 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-01d89be8-2639-4964-bf58-b2306455b243 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:25.090595 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-01d89be8-2639-4964-bf58-b2306455b243 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:25.092091 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-01d89be8-2639-4964-bf58-b2306455b243 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:25.093300 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-01d89be8-2639-4964-bf58-b2306455b243 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1730 microversion: 2.20 time: 0.256925 Sep 12 23:59:25.093901 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 349/694] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:59:24 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1730 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:59:25.745322 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-06024ab4-59ef-4e8f-a996-3c33d6f7cbfc tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:25.746013 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-06024ab4-59ef-4e8f-a996-3c33d6f7cbfc tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: f7a64139-3e2f-4855-a0d5-a667621b7ded] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:25.749051 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:59:25.755701 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-06024ab4-59ef-4e8f-a996-3c33d6f7cbfc tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:25.756328 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-06024ab4-59ef-4e8f-a996-3c33d6f7cbfc tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:25.756854 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-06024ab4-59ef-4e8f-a996-3c33d6f7cbfc tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:25.757838 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-06024ab4-59ef-4e8f-a996-3c33d6f7cbfc tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:25.758426 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-06024ab4-59ef-4e8f-a996-3c33d6f7cbfc tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:25.758941 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-06024ab4-59ef-4e8f-a996-3c33d6f7cbfc tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:25.906656 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-06024ab4-59ef-4e8f-a996-3c33d6f7cbfc tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:25.916704 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-06024ab4-59ef-4e8f-a996-3c33d6f7cbfc tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded" status: 200 len: 1364 microversion: 2.1 time: 0.175115 Sep 12 23:59:25.917296 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 346/695] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:59:25 2022] GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:59:26.121438 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-efcfe025-ba5f-4eba-9b7c-17057fbf8d6d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:26.122374 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-efcfe025-ba5f-4eba-9b7c-17057fbf8d6d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:26.131554 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-efcfe025-ba5f-4eba-9b7c-17057fbf8d6d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:26.132163 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-efcfe025-ba5f-4eba-9b7c-17057fbf8d6d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:26.132664 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-efcfe025-ba5f-4eba-9b7c-17057fbf8d6d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:26.133840 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-efcfe025-ba5f-4eba-9b7c-17057fbf8d6d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:26.134634 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-efcfe025-ba5f-4eba-9b7c-17057fbf8d6d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:26.135207 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-efcfe025-ba5f-4eba-9b7c-17057fbf8d6d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:26.284214 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-efcfe025-ba5f-4eba-9b7c-17057fbf8d6d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:26.293954 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-efcfe025-ba5f-4eba-9b7c-17057fbf8d6d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:26.295515 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-efcfe025-ba5f-4eba-9b7c-17057fbf8d6d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:26.296047 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1eed77e8-86f1-4833-bcec-85bf93337175 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:26.296671 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1eed77e8-86f1-4833-bcec-85bf93337175 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:26.296886 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-efcfe025-ba5f-4eba-9b7c-17057fbf8d6d tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1730 microversion: 2.20 time: 0.180676 Sep 12 23:59:26.297531 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 350/696] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:59:26 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:59:26.303500 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1eed77e8-86f1-4833-bcec-85bf93337175 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:26.304075 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1eed77e8-86f1-4833-bcec-85bf93337175 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:26.304594 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1eed77e8-86f1-4833-bcec-85bf93337175 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:26.305369 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1eed77e8-86f1-4833-bcec-85bf93337175 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:26.305912 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1eed77e8-86f1-4833-bcec-85bf93337175 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:26.306399 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1eed77e8-86f1-4833-bcec-85bf93337175 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:26.332486 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1eed77e8-86f1-4833-bcec-85bf93337175 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5/ips" status: 200 len: 150 microversion: 2.1 time: 0.040499 Sep 12 23:59:26.333009 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 347/697] 10.222.0.26 () {58 vars in 1248 bytes} [Mon Sep 12 23:59:26 2022] GET /compute/v2.1/servers/b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 23:59:26.941547 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-cfabc618-1c71-439e-9e15-e2ec711de20e tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:26.942249 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-cfabc618-1c71-439e-9e15-e2ec711de20e tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: f7a64139-3e2f-4855-a0d5-a667621b7ded] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:26.948780 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cfabc618-1c71-439e-9e15-e2ec711de20e tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:26.949265 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cfabc618-1c71-439e-9e15-e2ec711de20e tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:26.949696 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cfabc618-1c71-439e-9e15-e2ec711de20e tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:26.950393 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cfabc618-1c71-439e-9e15-e2ec711de20e tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:26.950840 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cfabc618-1c71-439e-9e15-e2ec711de20e tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:26.951280 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cfabc618-1c71-439e-9e15-e2ec711de20e tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:27.095872 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-cfabc618-1c71-439e-9e15-e2ec711de20e tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:27.108189 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-cfabc618-1c71-439e-9e15-e2ec711de20e tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded" status: 200 len: 1364 microversion: 2.1 time: 0.170304 Sep 12 23:59:27.108792 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 351/698] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:59:26 2022] GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:59:27.329912 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-6ad14b82-f75b-40e9-8671-834632621335 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:27.330950 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-6ad14b82-f75b-40e9-8671-834632621335 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:27.342348 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6ad14b82-f75b-40e9-8671-834632621335 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:27.343184 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6ad14b82-f75b-40e9-8671-834632621335 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:27.343919 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6ad14b82-f75b-40e9-8671-834632621335 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:27.345684 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6ad14b82-f75b-40e9-8671-834632621335 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:27.346659 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6ad14b82-f75b-40e9-8671-834632621335 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:27.347348 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-6ad14b82-f75b-40e9-8671-834632621335 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:27.521841 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6ad14b82-f75b-40e9-8671-834632621335 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:27.533147 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6ad14b82-f75b-40e9-8671-834632621335 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:27.535265 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-6ad14b82-f75b-40e9-8671-834632621335 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:27.536710 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-6ad14b82-f75b-40e9-8671-834632621335 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1730 microversion: 2.20 time: 0.213614 Sep 12 23:59:27.547104 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 348/699] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:59:27 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1730 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:59:27.699661 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a9ce4595-52eb-4939-a2b2-dfc67238f4e0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6b32425c-3bb3-4b8d-a930-47bf0c862f7b"}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:59:27.702158 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a9ce4595-52eb-4939-a2b2-dfc67238f4e0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:27.708807 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a9ce4595-52eb-4939-a2b2-dfc67238f4e0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:27.709306 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a9ce4595-52eb-4939-a2b2-dfc67238f4e0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:27.710024 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a9ce4595-52eb-4939-a2b2-dfc67238f4e0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:27.710645 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a9ce4595-52eb-4939-a2b2-dfc67238f4e0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:27.710927 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a9ce4595-52eb-4939-a2b2-dfc67238f4e0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:27.711341 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a9ce4595-52eb-4939-a2b2-dfc67238f4e0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:28.134862 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5cc8ca40-2e0d-4e3d-b18c-40648a202ebf tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:28.135985 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5cc8ca40-2e0d-4e3d-b18c-40648a202ebf tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: f7a64139-3e2f-4855-a0d5-a667621b7ded] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:28.143503 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a9ce4595-52eb-4939-a2b2-dfc67238f4e0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "POST /compute/v2.1/servers/b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.447620 Sep 12 23:59:28.144125 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 352/700] 10.222.0.26 () {60 vars in 1323 bytes} [Mon Sep 12 23:59:27 2022] POST /compute/v2.1/servers/b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5/os-volume_attachments => generated 194 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:59:28.150178 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5cc8ca40-2e0d-4e3d-b18c-40648a202ebf tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:28.150178 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5cc8ca40-2e0d-4e3d-b18c-40648a202ebf tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:28.150178 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5cc8ca40-2e0d-4e3d-b18c-40648a202ebf tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:28.150178 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5cc8ca40-2e0d-4e3d-b18c-40648a202ebf tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:28.160779 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5cc8ca40-2e0d-4e3d-b18c-40648a202ebf tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:28.165179 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5cc8ca40-2e0d-4e3d-b18c-40648a202ebf tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:28.352433 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-5cc8ca40-2e0d-4e3d-b18c-40648a202ebf tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:28.360631 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5cc8ca40-2e0d-4e3d-b18c-40648a202ebf tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded" status: 200 len: 1550 microversion: 2.1 time: 0.231891 Sep 12 23:59:28.361217 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 349/701] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:59:28 2022] GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded => generated 1550 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:59:28.385013 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-cb23759a-4880-4b09-ba82-c9542e2a0a69 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:28.385596 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-cb23759a-4880-4b09-ba82-c9542e2a0a69 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: f7a64139-3e2f-4855-a0d5-a667621b7ded] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:28.392246 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cb23759a-4880-4b09-ba82-c9542e2a0a69 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:28.392739 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cb23759a-4880-4b09-ba82-c9542e2a0a69 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:28.393177 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cb23759a-4880-4b09-ba82-c9542e2a0a69 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:28.393884 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cb23759a-4880-4b09-ba82-c9542e2a0a69 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:28.394338 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cb23759a-4880-4b09-ba82-c9542e2a0a69 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:28.395131 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-cb23759a-4880-4b09-ba82-c9542e2a0a69 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:28.500574 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-cb23759a-4880-4b09-ba82-c9542e2a0a69 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.120207 Sep 12 23:59:28.501144 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 353/702] 10.222.0.26 () {58 vars in 1275 bytes} [Mon Sep 12 23:59:28 2022] GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded/os-interface => generated 284 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:59:28.563379 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-bea5091d-8821-48a4-ae86-aa2f5c2b89af tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:28.564834 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-bea5091d-8821-48a4-ae86-aa2f5c2b89af tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:28.572243 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bea5091d-8821-48a4-ae86-aa2f5c2b89af tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:28.573056 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bea5091d-8821-48a4-ae86-aa2f5c2b89af tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:28.573669 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bea5091d-8821-48a4-ae86-aa2f5c2b89af tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:28.574896 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bea5091d-8821-48a4-ae86-aa2f5c2b89af tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:28.575604 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bea5091d-8821-48a4-ae86-aa2f5c2b89af tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:28.576186 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bea5091d-8821-48a4-ae86-aa2f5c2b89af tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:28.854838 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-bea5091d-8821-48a4-ae86-aa2f5c2b89af tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:28.864259 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-bea5091d-8821-48a4-ae86-aa2f5c2b89af tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:28.865910 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-bea5091d-8821-48a4-ae86-aa2f5c2b89af tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:28.867683 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-bea5091d-8821-48a4-ae86-aa2f5c2b89af tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1730 microversion: 2.20 time: 0.309317 Sep 12 23:59:28.868412 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 350/703] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:59:28 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1730 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:59:29.716549 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-a3e0bb4e-5815-40f2-a593-79fbb11c46bc req-d3d5a936-e8aa-4ad0-ae04-d2c651c57c04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7a64139-3e2f-4855-a0d5-a667621b7ded", "tag": "179e43ce-b6df-4eaa-9bf7-f66d5c59cb2f"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:59:29.738240 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-a3e0bb4e-5815-40f2-a593-79fbb11c46bc req-d3d5a936-e8aa-4ad0-ae04-d2c651c57c04 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:29.738884 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-a3e0bb4e-5815-40f2-a593-79fbb11c46bc req-d3d5a936-e8aa-4ad0-ae04-d2c651c57c04 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:29.739471 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-a3e0bb4e-5815-40f2-a593-79fbb11c46bc req-d3d5a936-e8aa-4ad0-ae04-d2c651c57c04 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:29.752980 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-a3e0bb4e-5815-40f2-a593-79fbb11c46bc req-d3d5a936-e8aa-4ad0-ae04-d2c651c57c04 service nova] Creating event network-changed:179e43ce-b6df-4eaa-9bf7-f66d5c59cb2f for instance f7a64139-3e2f-4855-a0d5-a667621b7ded on hv-cinder-82002 Sep 12 23:59:29.758476 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-a3e0bb4e-5815-40f2-a593-79fbb11c46bc req-d3d5a936-e8aa-4ad0-ae04-d2c651c57c04 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046172 Sep 12 23:59:29.763487 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 354/704] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:59:29.895313 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2f49776c-29dc-4376-9142-947c0287d501 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:29.896484 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2f49776c-29dc-4376-9142-947c0287d501 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:29.904070 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2f49776c-29dc-4376-9142-947c0287d501 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:29.904880 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2f49776c-29dc-4376-9142-947c0287d501 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:29.905544 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2f49776c-29dc-4376-9142-947c0287d501 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:29.906474 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2f49776c-29dc-4376-9142-947c0287d501 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:29.907247 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2f49776c-29dc-4376-9142-947c0287d501 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:29.907887 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2f49776c-29dc-4376-9142-947c0287d501 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:30.170113 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2f49776c-29dc-4376-9142-947c0287d501 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:30.180500 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2f49776c-29dc-4376-9142-947c0287d501 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:30.182889 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2f49776c-29dc-4376-9142-947c0287d501 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:30.184472 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2f49776c-29dc-4376-9142-947c0287d501 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1730 microversion: 2.20 time: 0.294088 Sep 12 23:59:30.196820 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 351/705] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:59:29 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1730 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:59:30.450129 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-82ba1110-5a42-4c60-afec-5d402a7a7d67 req-fc28ae59-d848-4a75-af04-e595f0063c02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3088bc31-f3ff-476d-a0ad-9f10186b442f", "name": "network-vif-plugged", "status": "completed", "tag": "8a984b84-cffe-442a-8574-f76c08213db0"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:59:30.460617 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-82ba1110-5a42-4c60-afec-5d402a7a7d67 req-fc28ae59-d848-4a75-af04-e595f0063c02 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:30.461343 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-82ba1110-5a42-4c60-afec-5d402a7a7d67 req-fc28ae59-d848-4a75-af04-e595f0063c02 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:30.461924 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-82ba1110-5a42-4c60-afec-5d402a7a7d67 req-fc28ae59-d848-4a75-af04-e595f0063c02 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:30.475533 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-82ba1110-5a42-4c60-afec-5d402a7a7d67 req-fc28ae59-d848-4a75-af04-e595f0063c02 service nova] Creating event network-vif-plugged:8a984b84-cffe-442a-8574-f76c08213db0 for instance 3088bc31-f3ff-476d-a0ad-9f10186b442f on hv-cinder-82002 Sep 12 23:59:30.481072 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-82ba1110-5a42-4c60-afec-5d402a7a7d67 req-fc28ae59-d848-4a75-af04-e595f0063c02 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035638 Sep 12 23:59:30.482411 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 355/706] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:59:31.214036 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-cf3d34ef-59ba-4b1b-a375-4b585f2c43ec tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:31.214657 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-cf3d34ef-59ba-4b1b-a375-4b585f2c43ec tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:31.221961 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cf3d34ef-59ba-4b1b-a375-4b585f2c43ec tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:31.222764 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cf3d34ef-59ba-4b1b-a375-4b585f2c43ec tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:31.223394 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cf3d34ef-59ba-4b1b-a375-4b585f2c43ec tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:31.224313 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cf3d34ef-59ba-4b1b-a375-4b585f2c43ec tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:31.224769 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cf3d34ef-59ba-4b1b-a375-4b585f2c43ec tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:31.225428 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cf3d34ef-59ba-4b1b-a375-4b585f2c43ec tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:31.422706 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-cf3d34ef-59ba-4b1b-a375-4b585f2c43ec tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:31.440978 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-cf3d34ef-59ba-4b1b-a375-4b585f2c43ec tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:31.442691 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-cf3d34ef-59ba-4b1b-a375-4b585f2c43ec tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:31.444311 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-cf3d34ef-59ba-4b1b-a375-4b585f2c43ec tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1730 microversion: 2.20 time: 0.234266 Sep 12 23:59:31.445274 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 352/707] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:59:31 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1730 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:59:32.490297 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-318e70c1-7976-4ef1-9918-64388448eb27 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:32.491061 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-318e70c1-7976-4ef1-9918-64388448eb27 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:32.497713 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-318e70c1-7976-4ef1-9918-64388448eb27 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:32.498213 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-318e70c1-7976-4ef1-9918-64388448eb27 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:32.498652 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-318e70c1-7976-4ef1-9918-64388448eb27 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:32.499410 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-318e70c1-7976-4ef1-9918-64388448eb27 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:32.499871 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-318e70c1-7976-4ef1-9918-64388448eb27 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:32.500323 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-318e70c1-7976-4ef1-9918-64388448eb27 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:32.670992 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-318e70c1-7976-4ef1-9918-64388448eb27 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:32.680758 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-318e70c1-7976-4ef1-9918-64388448eb27 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:32.682242 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-318e70c1-7976-4ef1-9918-64388448eb27 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:32.683487 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-318e70c1-7976-4ef1-9918-64388448eb27 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1730 microversion: 2.20 time: 0.198266 Sep 12 23:59:32.684051 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 356/708] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:59:32 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1730 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:59:33.000815 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-100245b1-4ab4-4673-a51f-533e98695a55 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-10264340", "imageRef": "22a47167-5e04-441a-a504-d76d82afc776", "flavorRef": "452", "networks": [{"uuid": "f3192aa0-69b1-4ced-9ab8-c4310d0134eb"}]}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:59:33.076399 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.network.neutron [None req-100245b1-4ab4-4673-a51f-533e98695a55 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] validate_networks() for [('f3192aa0-69b1-4ced-9ab8-c4310d0134eb', None, None, None, None, None)] {{(pid=126976) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 23:59:33.474853 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-100245b1-4ab4-4673-a51f-533e98695a55 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Flavor limits 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 23:59:33.475416 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-100245b1-4ab4-4673-a51f-533e98695a55 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Image limits 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 23:59:33.475895 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-100245b1-4ab4-4673-a51f-533e98695a55 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Flavor pref 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 23:59:33.476299 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-100245b1-4ab4-4673-a51f-533e98695a55 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Image pref 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 23:59:33.477007 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-100245b1-4ab4-4673-a51f-533e98695a55 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 23:59:33.492053 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-100245b1-4ab4-4673-a51f-533e98695a55 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:33.492785 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-100245b1-4ab4-4673-a51f-533e98695a55 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:33.493343 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-100245b1-4ab4-4673-a51f-533e98695a55 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:33.494251 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-100245b1-4ab4-4673-a51f-533e98695a55 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:33.494966 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-100245b1-4ab4-4673-a51f-533e98695a55 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:33.495600 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-100245b1-4ab4-4673-a51f-533e98695a55 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:33.525546 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-100245b1-4ab4-4673-a51f-533e98695a55 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Getting quotas for project 0d4c43138bd3461fb6d8fa9f924f7e99. Resources: {'instances', 'cores', 'ram'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 23:59:33.533093 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-100245b1-4ab4-4673-a51f-533e98695a55 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Getting quotas for user 568cea020ffb4b3fa74215dad3c17eba and project 0d4c43138bd3461fb6d8fa9f924f7e99. Resources: {'instances', 'cores', 'ram'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 23:59:33.553368 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-100245b1-4ab4-4673-a51f-533e98695a55 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Going to run 1 instances... {{(pid=126976) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 23:59:33.558049 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-100245b1-4ab4-4673-a51f-533e98695a55 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] [instance: c94c6c43-ea97-4c2f-a518-1e2c1bb80440] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='22a47167-5e04-441a-a504-d76d82afc776',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126976) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 23:59:33.623487 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-100245b1-4ab4-4673-a51f-533e98695a55 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.626615 Sep 12 23:59:33.629991 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 353/709] 10.222.0.26 () {60 vars in 1147 bytes} [Mon Sep 12 23:59:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 12 23:59:33.641266 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-69baf5ab-6245-4480-b753-def10e2e84c4 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:33.642191 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-69baf5ab-6245-4480-b753-def10e2e84c4 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] [instance: c94c6c43-ea97-4c2f-a518-1e2c1bb80440] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:33.712023 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5026faed-020a-453d-93db-881fee851a80 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:33.714167 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5026faed-020a-453d-93db-881fee851a80 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:33.724480 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5026faed-020a-453d-93db-881fee851a80 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:33.725401 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5026faed-020a-453d-93db-881fee851a80 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:33.726181 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5026faed-020a-453d-93db-881fee851a80 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:33.727162 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5026faed-020a-453d-93db-881fee851a80 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:33.727911 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5026faed-020a-453d-93db-881fee851a80 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:33.728634 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5026faed-020a-453d-93db-881fee851a80 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:33.741519 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-69baf5ab-6245-4480-b753-def10e2e84c4 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568cea020ffb4b3fa74215dad3c17eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4c43138bd3461fb6d8fa9f924f7e99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:33.752339 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-69baf5ab-6245-4480-b753-def10e2e84c4 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] 10.222.0.26 "GET /compute/v2.1/servers/c94c6c43-ea97-4c2f-a518-1e2c1bb80440" status: 200 len: 1212 microversion: 2.1 time: 0.115375 Sep 12 23:59:33.753531 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 357/710] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:59:33 2022] GET /compute/v2.1/servers/c94c6c43-ea97-4c2f-a518-1e2c1bb80440 => generated 1212 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:59:33.939653 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-5026faed-020a-453d-93db-881fee851a80 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:33.952527 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-5026faed-020a-453d-93db-881fee851a80 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:33.955654 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-5026faed-020a-453d-93db-881fee851a80 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:33.957449 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5026faed-020a-453d-93db-881fee851a80 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1717 microversion: 2.20 time: 0.250076 Sep 12 23:59:33.958191 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 354/711] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Sep 12 23:59:33 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1717 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 12 23:59:34.791610 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8b064e50-64e2-437a-9757-43771e0e3980 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:34.792453 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8b064e50-64e2-437a-9757-43771e0e3980 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] [instance: c94c6c43-ea97-4c2f-a518-1e2c1bb80440] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:34.801619 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8b064e50-64e2-437a-9757-43771e0e3980 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:34.802564 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8b064e50-64e2-437a-9757-43771e0e3980 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:34.803428 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8b064e50-64e2-437a-9757-43771e0e3980 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:34.804736 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8b064e50-64e2-437a-9757-43771e0e3980 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:34.806076 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8b064e50-64e2-437a-9757-43771e0e3980 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:34.807247 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8b064e50-64e2-437a-9757-43771e0e3980 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:34.905821 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8b064e50-64e2-437a-9757-43771e0e3980 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568cea020ffb4b3fa74215dad3c17eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4c43138bd3461fb6d8fa9f924f7e99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:34.914011 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8b064e50-64e2-437a-9757-43771e0e3980 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] 10.222.0.26 "GET /compute/v2.1/servers/c94c6c43-ea97-4c2f-a518-1e2c1bb80440" status: 200 len: 1264 microversion: 2.1 time: 0.127608 Sep 12 23:59:34.914719 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 358/712] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:59:34 2022] GET /compute/v2.1/servers/c94c6c43-ea97-4c2f-a518-1e2c1bb80440 => generated 1264 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:59:35.010057 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-345bfcb0-1985-4402-a708-4749dddacd50 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:35.010714 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-345bfcb0-1985-4402-a708-4749dddacd50 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:35.018053 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-345bfcb0-1985-4402-a708-4749dddacd50 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:35.018554 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-345bfcb0-1985-4402-a708-4749dddacd50 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:35.018991 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-345bfcb0-1985-4402-a708-4749dddacd50 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:35.020127 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-345bfcb0-1985-4402-a708-4749dddacd50 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:35.020590 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-345bfcb0-1985-4402-a708-4749dddacd50 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:35.021022 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-345bfcb0-1985-4402-a708-4749dddacd50 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:35.112536 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.objects.instance [None req-345bfcb0-1985-4402-a708-4749dddacd50 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lazy-loading 'services' on Instance uuid b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5 {{(pid=126976) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 23:59:35.234936 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-345bfcb0-1985-4402-a708-4749dddacd50 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5/os-volume_attachments/6b32425c-3bb3-4b8d-a930-47bf0c862f7b" status: 202 len: 0 microversion: 2.1 time: 0.228223 Sep 12 23:59:35.235761 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 355/713] 10.222.0.26 () {58 vars in 1416 bytes} [Mon Sep 12 23:59:35 2022] DELETE /compute/v2.1/servers/b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5/os-volume_attachments/6b32425c-3bb3-4b8d-a930-47bf0c862f7b => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 12 23:59:35.244864 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-17c115db-4fb8-42db-bdfe-5a0ad26bb3b5 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:35.247285 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-17c115db-4fb8-42db-bdfe-5a0ad26bb3b5 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:35.265327 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-17c115db-4fb8-42db-bdfe-5a0ad26bb3b5 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:35.265858 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-17c115db-4fb8-42db-bdfe-5a0ad26bb3b5 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:35.266321 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-17c115db-4fb8-42db-bdfe-5a0ad26bb3b5 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:35.267042 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-17c115db-4fb8-42db-bdfe-5a0ad26bb3b5 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:35.267522 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-17c115db-4fb8-42db-bdfe-5a0ad26bb3b5 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:35.268135 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-17c115db-4fb8-42db-bdfe-5a0ad26bb3b5 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:35.329848 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-17c115db-4fb8-42db-bdfe-5a0ad26bb3b5 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089226 Sep 12 23:59:35.330999 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 359/714] 10.222.0.26 () {58 vars in 1302 bytes} [Mon Sep 12 23:59:35 2022] GET /compute/v2.1/servers/b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 23:59:35.941506 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0f5b0cde-68a4-492d-acad-c611d4f0acbd tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:35.942906 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0f5b0cde-68a4-492d-acad-c611d4f0acbd tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] [instance: c94c6c43-ea97-4c2f-a518-1e2c1bb80440] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:35.954051 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0f5b0cde-68a4-492d-acad-c611d4f0acbd tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:35.955049 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0f5b0cde-68a4-492d-acad-c611d4f0acbd tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:35.955673 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0f5b0cde-68a4-492d-acad-c611d4f0acbd tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:35.956773 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0f5b0cde-68a4-492d-acad-c611d4f0acbd tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:35.957339 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0f5b0cde-68a4-492d-acad-c611d4f0acbd tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:35.957986 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0f5b0cde-68a4-492d-acad-c611d4f0acbd tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:36.072311 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0f5b0cde-68a4-492d-acad-c611d4f0acbd tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568cea020ffb4b3fa74215dad3c17eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4c43138bd3461fb6d8fa9f924f7e99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:36.087904 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0f5b0cde-68a4-492d-acad-c611d4f0acbd tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] 10.222.0.26 "GET /compute/v2.1/servers/c94c6c43-ea97-4c2f-a518-1e2c1bb80440" status: 200 len: 1270 microversion: 2.1 time: 0.152158 Sep 12 23:59:36.088988 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 356/715] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:59:35 2022] GET /compute/v2.1/servers/c94c6c43-ea97-4c2f-a518-1e2c1bb80440 => generated 1270 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:59:36.345081 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1ffd5abc-4874-4fda-b345-86ee09ea2ddd tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:36.347776 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1ffd5abc-4874-4fda-b345-86ee09ea2ddd tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:36.356602 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1ffd5abc-4874-4fda-b345-86ee09ea2ddd tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:36.357450 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1ffd5abc-4874-4fda-b345-86ee09ea2ddd tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:36.357961 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1ffd5abc-4874-4fda-b345-86ee09ea2ddd tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:36.358782 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1ffd5abc-4874-4fda-b345-86ee09ea2ddd tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:36.359373 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1ffd5abc-4874-4fda-b345-86ee09ea2ddd tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:36.360154 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1ffd5abc-4874-4fda-b345-86ee09ea2ddd tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:36.395996 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1ffd5abc-4874-4fda-b345-86ee09ea2ddd tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055454 Sep 12 23:59:36.396621 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 360/716] 10.222.0.26 () {58 vars in 1302 bytes} [Mon Sep 12 23:59:36 2022] GET /compute/v2.1/servers/b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 12 23:59:36.470245 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-793a1968-5161-4067-89bc-9332a891cde0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:36.470742 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-793a1968-5161-4067-89bc-9332a891cde0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:36.477585 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-793a1968-5161-4067-89bc-9332a891cde0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:36.478064 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-793a1968-5161-4067-89bc-9332a891cde0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:36.478494 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-793a1968-5161-4067-89bc-9332a891cde0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:36.479267 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-793a1968-5161-4067-89bc-9332a891cde0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:36.479713 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-793a1968-5161-4067-89bc-9332a891cde0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:36.480137 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-793a1968-5161-4067-89bc-9332a891cde0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:36.509214 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-793a1968-5161-4067-89bc-9332a891cde0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5] Going to try to terminate instance {{(pid=126976) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 23:59:36.550359 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:59:36.636777 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-793a1968-5161-4067-89bc-9332a891cde0 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5" status: 204 len: 0 microversion: 2.1 time: 0.167716 Sep 12 23:59:36.638179 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 357/717] 10.222.0.26 () {58 vars in 1239 bytes} [Mon Sep 12 23:59:36 2022] DELETE /compute/v2.1/servers/b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 12 23:59:36.649125 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2bfeb2a1-8eb3-4c69-abd3-65601c4feb94 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:36.649752 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2bfeb2a1-8eb3-4c69-abd3-65601c4feb94 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:36.656396 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2bfeb2a1-8eb3-4c69-abd3-65601c4feb94 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:36.656901 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2bfeb2a1-8eb3-4c69-abd3-65601c4feb94 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:36.657343 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2bfeb2a1-8eb3-4c69-abd3-65601c4feb94 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:36.658073 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2bfeb2a1-8eb3-4c69-abd3-65601c4feb94 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:36.658527 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2bfeb2a1-8eb3-4c69-abd3-65601c4feb94 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:36.658949 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2bfeb2a1-8eb3-4c69-abd3-65601c4feb94 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:36.912589 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2bfeb2a1-8eb3-4c69-abd3-65601c4feb94 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:36.927774 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2bfeb2a1-8eb3-4c69-abd3-65601c4feb94 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5" status: 200 len: 1683 microversion: 2.1 time: 0.283213 Sep 12 23:59:36.928383 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 361/718] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:59:36 2022] GET /compute/v2.1/servers/b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5 => generated 1683 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:59:37.113380 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d6c21442-25bc-4bf6-b93a-92cdc800e071 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:37.114755 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d6c21442-25bc-4bf6-b93a-92cdc800e071 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] [instance: c94c6c43-ea97-4c2f-a518-1e2c1bb80440] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:37.121758 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d6c21442-25bc-4bf6-b93a-92cdc800e071 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:37.122240 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d6c21442-25bc-4bf6-b93a-92cdc800e071 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:37.122672 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d6c21442-25bc-4bf6-b93a-92cdc800e071 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:37.123448 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d6c21442-25bc-4bf6-b93a-92cdc800e071 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:37.123876 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d6c21442-25bc-4bf6-b93a-92cdc800e071 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:37.124298 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d6c21442-25bc-4bf6-b93a-92cdc800e071 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:37.232948 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-5745af4c-abc7-434f-ad3d-d4ec026126f7 req-b10f0fb3-ef87-40ef-a1cc-b3559052ae98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c94c6c43-ea97-4c2f-a518-1e2c1bb80440", "tag": "11b2be14-8993-40cd-b022-a16de185f5a0"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:59:37.247793 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-5745af4c-abc7-434f-ad3d-d4ec026126f7 req-b10f0fb3-ef87-40ef-a1cc-b3559052ae98 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:37.248426 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-5745af4c-abc7-434f-ad3d-d4ec026126f7 req-b10f0fb3-ef87-40ef-a1cc-b3559052ae98 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:37.249103 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-5745af4c-abc7-434f-ad3d-d4ec026126f7 req-b10f0fb3-ef87-40ef-a1cc-b3559052ae98 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:37.266360 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-5745af4c-abc7-434f-ad3d-d4ec026126f7 req-b10f0fb3-ef87-40ef-a1cc-b3559052ae98 service nova] Creating event network-changed:11b2be14-8993-40cd-b022-a16de185f5a0 for instance c94c6c43-ea97-4c2f-a518-1e2c1bb80440 on hv-cinder-82002 Sep 12 23:59:37.276135 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-5745af4c-abc7-434f-ad3d-d4ec026126f7 req-b10f0fb3-ef87-40ef-a1cc-b3559052ae98 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048299 Sep 12 23:59:37.277248 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 362/719] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:59:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 23:59:37.375625 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d6c21442-25bc-4bf6-b93a-92cdc800e071 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568cea020ffb4b3fa74215dad3c17eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4c43138bd3461fb6d8fa9f924f7e99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:37.384340 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d6c21442-25bc-4bf6-b93a-92cdc800e071 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] 10.222.0.26 "GET /compute/v2.1/servers/c94c6c43-ea97-4c2f-a518-1e2c1bb80440" status: 200 len: 1312 microversion: 2.1 time: 0.275358 Sep 12 23:59:37.384941 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 358/720] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:59:37 2022] GET /compute/v2.1/servers/c94c6c43-ea97-4c2f-a518-1e2c1bb80440 => generated 1312 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:59:37.954495 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4736cdee-929f-4db8-b277-e15b5b3450e1 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:37.955348 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4736cdee-929f-4db8-b277-e15b5b3450e1 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:37.963107 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4736cdee-929f-4db8-b277-e15b5b3450e1 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:37.963635 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4736cdee-929f-4db8-b277-e15b5b3450e1 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:37.964300 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4736cdee-929f-4db8-b277-e15b5b3450e1 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:37.965199 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4736cdee-929f-4db8-b277-e15b5b3450e1 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:37.965830 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4736cdee-929f-4db8-b277-e15b5b3450e1 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:37.966429 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4736cdee-929f-4db8-b277-e15b5b3450e1 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:38.377228 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4736cdee-929f-4db8-b277-e15b5b3450e1 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:38.386059 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4736cdee-929f-4db8-b277-e15b5b3450e1 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5" status: 200 len: 1683 microversion: 2.1 time: 0.436913 Sep 12 23:59:38.386772 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 363/721] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:59:37 2022] GET /compute/v2.1/servers/b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5 => generated 1683 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:59:38.412465 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e2eab678-1067-4c06-854a-06554e81f08b tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:38.413551 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e2eab678-1067-4c06-854a-06554e81f08b tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] [instance: c94c6c43-ea97-4c2f-a518-1e2c1bb80440] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:38.422236 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e2eab678-1067-4c06-854a-06554e81f08b tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:38.422956 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e2eab678-1067-4c06-854a-06554e81f08b tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:38.423576 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e2eab678-1067-4c06-854a-06554e81f08b tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:38.424394 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e2eab678-1067-4c06-854a-06554e81f08b tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:38.425056 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e2eab678-1067-4c06-854a-06554e81f08b tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:38.425586 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e2eab678-1067-4c06-854a-06554e81f08b tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:38.796851 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e2eab678-1067-4c06-854a-06554e81f08b tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568cea020ffb4b3fa74215dad3c17eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4c43138bd3461fb6d8fa9f924f7e99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:38.819204 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e2eab678-1067-4c06-854a-06554e81f08b tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] 10.222.0.26 "GET /compute/v2.1/servers/c94c6c43-ea97-4c2f-a518-1e2c1bb80440" status: 200 len: 1312 microversion: 2.1 time: 0.413531 Sep 12 23:59:38.823427 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 359/722] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:59:38 2022] GET /compute/v2.1/servers/c94c6c43-ea97-4c2f-a518-1e2c1bb80440 => generated 1312 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:59:39.416785 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-85e54415-6168-42df-b8ab-931593a6aa96 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:39.417541 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-85e54415-6168-42df-b8ab-931593a6aa96 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:39.420490 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=62 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:59:39.428173 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-85e54415-6168-42df-b8ab-931593a6aa96 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:39.428643 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-85e54415-6168-42df-b8ab-931593a6aa96 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:39.429153 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-85e54415-6168-42df-b8ab-931593a6aa96 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:39.430347 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-85e54415-6168-42df-b8ab-931593a6aa96 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:39.430992 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-85e54415-6168-42df-b8ab-931593a6aa96 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:39.431688 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-85e54415-6168-42df-b8ab-931593a6aa96 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:39.730426 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-85e54415-6168-42df-b8ab-931593a6aa96 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:39.741564 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-85e54415-6168-42df-b8ab-931593a6aa96 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5" status: 200 len: 1683 microversion: 2.1 time: 0.330249 Sep 12 23:59:39.742393 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 364/723] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:59:39 2022] GET /compute/v2.1/servers/b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5 => generated 1683 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:59:39.848937 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-622f1d70-9b1f-453c-98b8-c1d0036fe5ff tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:39.850045 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-622f1d70-9b1f-453c-98b8-c1d0036fe5ff tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] [instance: c94c6c43-ea97-4c2f-a518-1e2c1bb80440] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:39.858766 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-622f1d70-9b1f-453c-98b8-c1d0036fe5ff tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:39.859467 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-622f1d70-9b1f-453c-98b8-c1d0036fe5ff tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:39.860019 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-622f1d70-9b1f-453c-98b8-c1d0036fe5ff tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:39.860860 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-622f1d70-9b1f-453c-98b8-c1d0036fe5ff tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:39.861656 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-622f1d70-9b1f-453c-98b8-c1d0036fe5ff tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:39.862191 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-622f1d70-9b1f-453c-98b8-c1d0036fe5ff tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:40.103781 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-904d8b5f-d962-4561-a437-0976d0b5fd87 req-1b75dfcd-cba6-49b9-9a4e-e3a6a831e4c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5", "name": "network-vif-deleted", "tag": "3518a015-4b9d-49ce-83c7-2bc6c147a0ba"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:59:40.108458 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-622f1d70-9b1f-453c-98b8-c1d0036fe5ff tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568cea020ffb4b3fa74215dad3c17eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4c43138bd3461fb6d8fa9f924f7e99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:40.121589 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-904d8b5f-d962-4561-a437-0976d0b5fd87 req-1b75dfcd-cba6-49b9-9a4e-e3a6a831e4c8 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:40.121887 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-622f1d70-9b1f-453c-98b8-c1d0036fe5ff tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] 10.222.0.26 "GET /compute/v2.1/servers/c94c6c43-ea97-4c2f-a518-1e2c1bb80440" status: 200 len: 1312 microversion: 2.1 time: 0.277163 Sep 12 23:59:40.122712 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 360/724] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:59:39 2022] GET /compute/v2.1/servers/c94c6c43-ea97-4c2f-a518-1e2c1bb80440 => generated 1312 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:59:40.128655 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-904d8b5f-d962-4561-a437-0976d0b5fd87 req-1b75dfcd-cba6-49b9-9a4e-e3a6a831e4c8 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:40.128655 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-904d8b5f-d962-4561-a437-0976d0b5fd87 req-1b75dfcd-cba6-49b9-9a4e-e3a6a831e4c8 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:40.151575 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-904d8b5f-d962-4561-a437-0976d0b5fd87 req-1b75dfcd-cba6-49b9-9a4e-e3a6a831e4c8 service nova] Creating event network-vif-deleted:3518a015-4b9d-49ce-83c7-2bc6c147a0ba for instance b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5 on hv-cinder-82002 Sep 12 23:59:40.158746 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-904d8b5f-d962-4561-a437-0976d0b5fd87 req-1b75dfcd-cba6-49b9-9a4e-e3a6a831e4c8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064854 Sep 12 23:59:40.159819 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 365/725] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:59:40.783562 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0886e54a-4751-4744-bd6a-4a50aa76b996 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:40.784450 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0886e54a-4751-4744-bd6a-4a50aa76b996 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:40.793391 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0886e54a-4751-4744-bd6a-4a50aa76b996 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:40.794195 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0886e54a-4751-4744-bd6a-4a50aa76b996 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:40.794932 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0886e54a-4751-4744-bd6a-4a50aa76b996 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:40.796578 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0886e54a-4751-4744-bd6a-4a50aa76b996 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:40.809103 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0886e54a-4751-4744-bd6a-4a50aa76b996 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:40.809683 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0886e54a-4751-4744-bd6a-4a50aa76b996 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:40.871690 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0886e54a-4751-4744-bd6a-4a50aa76b996 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:40.872564 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0886e54a-4751-4744-bd6a-4a50aa76b996 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:40.873220 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0886e54a-4751-4744-bd6a-4a50aa76b996 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:40.874001 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.objects.instance [None req-0886e54a-4751-4744-bd6a-4a50aa76b996 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lazy-loading 'fault' on Instance uuid b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5 {{(pid=126976) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 12 23:59:40.931271 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0886e54a-4751-4744-bd6a-4a50aa76b996 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8cbfc74644f4d4594a70b833ad7002c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c681f1232de4a5fbfc728c230f80624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:40.940826 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0886e54a-4751-4744-bd6a-4a50aa76b996 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5" status: 200 len: 1332 microversion: 2.1 time: 0.165667 Sep 12 23:59:40.941623 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 361/726] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:59:40 2022] GET /compute/v2.1/servers/b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5 => generated 1332 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:59:41.148871 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7877c3f4-ef67-4ade-b566-4e0552187364 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:41.149575 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7877c3f4-ef67-4ade-b566-4e0552187364 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] [instance: c94c6c43-ea97-4c2f-a518-1e2c1bb80440] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:41.157946 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7877c3f4-ef67-4ade-b566-4e0552187364 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:41.158798 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7877c3f4-ef67-4ade-b566-4e0552187364 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:41.159555 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7877c3f4-ef67-4ade-b566-4e0552187364 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:41.160532 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7877c3f4-ef67-4ade-b566-4e0552187364 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:41.161238 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7877c3f4-ef67-4ade-b566-4e0552187364 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:41.162046 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7877c3f4-ef67-4ade-b566-4e0552187364 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:41.344512 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7877c3f4-ef67-4ade-b566-4e0552187364 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568cea020ffb4b3fa74215dad3c17eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4c43138bd3461fb6d8fa9f924f7e99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:41.353752 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7877c3f4-ef67-4ade-b566-4e0552187364 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] 10.222.0.26 "GET /compute/v2.1/servers/c94c6c43-ea97-4c2f-a518-1e2c1bb80440" status: 200 len: 1312 microversion: 2.1 time: 0.210135 Sep 12 23:59:41.354777 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 366/727] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:59:41 2022] GET /compute/v2.1/servers/c94c6c43-ea97-4c2f-a518-1e2c1bb80440 => generated 1312 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:59:41.968040 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7a932e0d-2011-42e5-9267-0aa9fff514d2 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:41.969087 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7a932e0d-2011-42e5-9267-0aa9fff514d2 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:41.976992 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7a932e0d-2011-42e5-9267-0aa9fff514d2 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:41.977567 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7a932e0d-2011-42e5-9267-0aa9fff514d2 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:41.978198 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7a932e0d-2011-42e5-9267-0aa9fff514d2 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:41.979013 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7a932e0d-2011-42e5-9267-0aa9fff514d2 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:41.979673 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7a932e0d-2011-42e5-9267-0aa9fff514d2 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:41.980304 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7a932e0d-2011-42e5-9267-0aa9fff514d2 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:41.997954 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-7a932e0d-2011-42e5-9267-0aa9fff514d2 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] HTTP exception thrown: Instance b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5 could not be found. Sep 12 23:59:41.999627 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7a932e0d-2011-42e5-9267-0aa9fff514d2 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Request method failure captured: Sep 12 23:59:41.999627 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: request: GET /compute/v2.1/servers/b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5 HTTP/1.1 Sep 12 23:59:41.999627 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Accept: application/json Sep 12 23:59:41.999627 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Sep 12 23:59:41.999627 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Connection: close Sep 12 23:59:41.999627 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Content-Length: 0 Sep 12 23:59:41.999627 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Content-Type: application/json Sep 12 23:59:41.999627 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Host: 10.222.0.26 Sep 12 23:59:41.999627 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Sep 12 23:59:41.999627 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Sep 12 23:59:41.999627 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjH8Z2hSl_dF3G_DVeQeMffC839mjKCX1ldHy7KYxwLbzxfI-Hnili9xft2wG7WgRYfuNYC0jIjSduHyiAWMPed8uo_fiAxdNKw8dFJEFK0lHOKo1_8VeXMUxxHgYF50XY0v_lkkNk_ejqmvpqtZKiNqfO8LXenu9zNmJy4upaAKztdpU Sep 12 23:59:41.999627 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Sep 12 23:59:41.999627 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Sep 12 23:59:41.999627 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Sep 12 23:59:41.999627 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Sep 12 23:59:41.999627 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Sep 12 23:59:41.999627 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Sep 12 23:59:41.999627 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Id: 6c681f1232de4a5fbfc728c230f80624 Sep 12 23:59:41.999627 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-AttachVolumeNegativeTest-1965954712 Sep 12 23:59:41.999627 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Role: member,reader Sep 12 23:59:41.999627 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Roles: member,reader Sep 12 23:59:42.007757 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6c681f1232de4a5fbfc728c230f80624"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6c681f1232de4a5fbfc728c230f80624"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6c681f1232de4a5fbfc728c230f80624"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6c681f1232de4a5fbfc728c230f80624"}]}] Sep 12 23:59:42.007757 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-AttachVolumeNegativeTest-1965954712 Sep 12 23:59:42.007757 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant-Id: 6c681f1232de4a5fbfc728c230f80624 Sep 12 23:59:42.007757 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1965954712 Sep 12 23:59:42.007757 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User: tempest-AttachVolumeNegativeTest-1965954712-project Sep 12 23:59:42.007757 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Sep 12 23:59:42.007757 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Sep 12 23:59:42.007757 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Id: a8cbfc74644f4d4594a70b833ad7002c Sep 12 23:59:42.007757 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-AttachVolumeNegativeTest-1965954712-project Sep 12 23:59:42.007757 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: method: > Sep 12 23:59:42.007757 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: exception: Instance b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5 could not be found. Sep 12 23:59:42.007757 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: action_args: {'id': 'b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5'} Sep 12 23:59:42.008609 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:59:42.008609 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:59:42.008609 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:59:42.008609 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:59:42.008609 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:59:42.008609 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:59:42.008609 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:59:42.008609 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:59:42.008609 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:59:42.008609 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:59:42.008609 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5 could not be found. Sep 12 23:59:42.008609 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:59:42.008609 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:59:42.008609 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:59:42.008609 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:59:42.008609 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:59:42.008609 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:59:42.008609 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:59:42.008609 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:59:42.008609 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:59:42.009948 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:59:42.009948 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 23:59:42.009948 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 23:59:42.009948 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:59:42.009948 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:59:42.009948 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:59:42.009948 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:59:42.009948 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5 could not be found. Sep 12 23:59:42.009948 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:59:42.009948 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:59:42.009948 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:59:42.009948 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:59:42.009948 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:59:42.009948 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:59:42.009948 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:59:42.009948 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:59:42.009948 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5 could not be found. Sep 12 23:59:42.009948 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:59:42.011064 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7a932e0d-2011-42e5-9267-0aa9fff514d2 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Returning 404 to user: Instance b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5 could not be found. {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:59:42.011064 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7a932e0d-2011-42e5-9267-0aa9fff514d2 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5" status: 404 len: 111 microversion: 2.1 time: 0.037889 Sep 12 23:59:42.011064 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 362/728] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:59:41 2022] GET /compute/v2.1/servers/b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:59:42.017258 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-eb8eeb9f-609f-4beb-8f89-1b979e312476 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '.version_select at 0x7fed012de700>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:42.050292 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-eb8eeb9f-609f-4beb-8f89-1b979e312476 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2038580038" status: 202 len: 0 microversion: 2.1 time: 0.040772 Sep 12 23:59:42.051025 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 367/729] 10.222.0.26 () {58 vars in 1221 bytes} [Mon Sep 12 23:59:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2038580038 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 12 23:59:42.381845 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f49c4f51-840e-45a3-9f8b-bd7db7a19f30 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:42.383536 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f49c4f51-840e-45a3-9f8b-bd7db7a19f30 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] [instance: c94c6c43-ea97-4c2f-a518-1e2c1bb80440] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:42.395615 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f49c4f51-840e-45a3-9f8b-bd7db7a19f30 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:42.396593 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f49c4f51-840e-45a3-9f8b-bd7db7a19f30 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:42.397450 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f49c4f51-840e-45a3-9f8b-bd7db7a19f30 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:42.398861 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f49c4f51-840e-45a3-9f8b-bd7db7a19f30 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:42.399859 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f49c4f51-840e-45a3-9f8b-bd7db7a19f30 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:42.400707 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f49c4f51-840e-45a3-9f8b-bd7db7a19f30 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:42.672290 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f49c4f51-840e-45a3-9f8b-bd7db7a19f30 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568cea020ffb4b3fa74215dad3c17eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4c43138bd3461fb6d8fa9f924f7e99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:42.687342 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f49c4f51-840e-45a3-9f8b-bd7db7a19f30 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] 10.222.0.26 "GET /compute/v2.1/servers/c94c6c43-ea97-4c2f-a518-1e2c1bb80440" status: 200 len: 1312 microversion: 2.1 time: 0.311657 Sep 12 23:59:42.688416 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 363/730] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:59:42 2022] GET /compute/v2.1/servers/c94c6c43-ea97-4c2f-a518-1e2c1bb80440 => generated 1312 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:59:43.713000 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-095378c1-e92a-4f31-9acc-9f6bc29a4232 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:43.713636 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-095378c1-e92a-4f31-9acc-9f6bc29a4232 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] [instance: c94c6c43-ea97-4c2f-a518-1e2c1bb80440] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:43.719905 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-095378c1-e92a-4f31-9acc-9f6bc29a4232 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:43.720398 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-095378c1-e92a-4f31-9acc-9f6bc29a4232 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:43.720857 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-095378c1-e92a-4f31-9acc-9f6bc29a4232 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:43.721557 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-095378c1-e92a-4f31-9acc-9f6bc29a4232 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:43.721988 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-095378c1-e92a-4f31-9acc-9f6bc29a4232 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:43.722403 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-095378c1-e92a-4f31-9acc-9f6bc29a4232 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:43.743265 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:59:43.747063 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell0:SELECT=2 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:59:43.880456 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-095378c1-e92a-4f31-9acc-9f6bc29a4232 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568cea020ffb4b3fa74215dad3c17eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4c43138bd3461fb6d8fa9f924f7e99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:43.895368 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-095378c1-e92a-4f31-9acc-9f6bc29a4232 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] 10.222.0.26 "GET /compute/v2.1/servers/c94c6c43-ea97-4c2f-a518-1e2c1bb80440" status: 200 len: 1312 microversion: 2.1 time: 0.186797 Sep 12 23:59:43.896401 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 368/731] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:59:43 2022] GET /compute/v2.1/servers/c94c6c43-ea97-4c2f-a518-1e2c1bb80440 => generated 1312 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:59:44.151394 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell0:SELECT=2 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:59:44.152922 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell0:SELECT=6 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:59:44.159980 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-c7b92eaa-cc4a-478f-a1fc-6a70af0985a5 req-a4a99b18-9fd9-406e-8215-77f14a93cd09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c94c6c43-ea97-4c2f-a518-1e2c1bb80440", "name": "network-vif-plugged", "status": "completed", "tag": "11b2be14-8993-40cd-b022-a16de185f5a0"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:59:44.184935 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-c7b92eaa-cc4a-478f-a1fc-6a70af0985a5 req-a4a99b18-9fd9-406e-8215-77f14a93cd09 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:44.184935 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-c7b92eaa-cc4a-478f-a1fc-6a70af0985a5 req-a4a99b18-9fd9-406e-8215-77f14a93cd09 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:44.184935 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-c7b92eaa-cc4a-478f-a1fc-6a70af0985a5 req-a4a99b18-9fd9-406e-8215-77f14a93cd09 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:44.201615 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-84ff03d2-2864-4a32-b979-0543215ba3a7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:44.202550 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-84ff03d2-2864-4a32-b979-0543215ba3a7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:44.203902 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-c7b92eaa-cc4a-478f-a1fc-6a70af0985a5 req-a4a99b18-9fd9-406e-8215-77f14a93cd09 service nova] Creating event network-vif-plugged:11b2be14-8993-40cd-b022-a16de185f5a0 for instance c94c6c43-ea97-4c2f-a518-1e2c1bb80440 on hv-cinder-82002 Sep 12 23:59:44.213094 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-c7b92eaa-cc4a-478f-a1fc-6a70af0985a5 req-a4a99b18-9fd9-406e-8215-77f14a93cd09 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063141 Sep 12 23:59:44.214192 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 364/732] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 23:59:44.215305 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-84ff03d2-2864-4a32-b979-0543215ba3a7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:44.217074 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-84ff03d2-2864-4a32-b979-0543215ba3a7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:44.217900 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-84ff03d2-2864-4a32-b979-0543215ba3a7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:44.218794 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-84ff03d2-2864-4a32-b979-0543215ba3a7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:44.219474 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-84ff03d2-2864-4a32-b979-0543215ba3a7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:44.220718 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-84ff03d2-2864-4a32-b979-0543215ba3a7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:44.238661 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-84ff03d2-2864-4a32-b979-0543215ba3a7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] HTTP exception thrown: Instance b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5 could not be found. Sep 12 23:59:44.240501 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-84ff03d2-2864-4a32-b979-0543215ba3a7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Request method failure captured: Sep 12 23:59:44.240501 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: request: DELETE /compute/v2.1/servers/b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5 HTTP/1.1 Sep 12 23:59:44.240501 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept: application/json Sep 12 23:59:44.240501 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Sep 12 23:59:44.240501 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Connection: close Sep 12 23:59:44.240501 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Length: 0 Sep 12 23:59:44.240501 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Type: application/json Sep 12 23:59:44.240501 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Host: 10.222.0.26 Sep 12 23:59:44.240501 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Sep 12 23:59:44.240501 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Sep 12 23:59:44.240501 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjH8Z2hSl_dF3G_DVeQeMffC839mjKCX1ldHy7KYxwLbzxfI-Hnili9xft2wG7WgRYfuNYC0jIjSduHyiAWMPed8uo_fiAxdNKw8dFJEFK0lHOKo1_8VeXMUxxHgYF50XY0v_lkkNk_ejqmvpqtZKiNqfO8LXenu9zNmJy4upaAKztdpU Sep 12 23:59:44.240501 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Sep 12 23:59:44.240501 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Sep 12 23:59:44.240501 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Sep 12 23:59:44.240501 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Sep 12 23:59:44.240501 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Sep 12 23:59:44.240501 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Sep 12 23:59:44.240501 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Id: 6c681f1232de4a5fbfc728c230f80624 Sep 12 23:59:44.240501 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-AttachVolumeNegativeTest-1965954712 Sep 12 23:59:44.240501 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Role: member,reader Sep 12 23:59:44.240501 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Roles: member,reader Sep 12 23:59:44.242909 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6c681f1232de4a5fbfc728c230f80624"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6c681f1232de4a5fbfc728c230f80624"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6c681f1232de4a5fbfc728c230f80624"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6c681f1232de4a5fbfc728c230f80624"}]}] Sep 12 23:59:44.242909 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-AttachVolumeNegativeTest-1965954712 Sep 12 23:59:44.242909 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Id: 6c681f1232de4a5fbfc728c230f80624 Sep 12 23:59:44.242909 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1965954712 Sep 12 23:59:44.242909 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User: tempest-AttachVolumeNegativeTest-1965954712-project Sep 12 23:59:44.242909 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Sep 12 23:59:44.242909 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Sep 12 23:59:44.242909 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Id: a8cbfc74644f4d4594a70b833ad7002c Sep 12 23:59:44.242909 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-AttachVolumeNegativeTest-1965954712-project Sep 12 23:59:44.242909 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: method: > Sep 12 23:59:44.242909 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: exception: Instance b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5 could not be found. Sep 12 23:59:44.242909 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: action_args: {'id': 'b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5'} Sep 12 23:59:44.244172 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:59:44.244172 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:59:44.244172 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:59:44.244172 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:59:44.244172 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:59:44.244172 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:59:44.244172 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:59:44.244172 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:59:44.244172 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:59:44.244172 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:59:44.244172 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5 could not be found. Sep 12 23:59:44.244172 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:59:44.244172 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:59:44.244172 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:59:44.244172 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:59:44.244172 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:59:44.244172 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:59:44.244172 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:59:44.244172 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:59:44.244172 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:59:44.246753 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:59:44.246753 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 12 23:59:44.246753 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 12 23:59:44.246753 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 12 23:59:44.246753 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 12 23:59:44.246753 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:59:44.246753 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:59:44.246753 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:59:44.246753 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:59:44.246753 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5 could not be found. Sep 12 23:59:44.246753 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:59:44.246753 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:59:44.246753 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:59:44.246753 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:59:44.246753 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:59:44.246753 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:59:44.246753 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:59:44.246753 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:59:44.246753 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5 could not be found. Sep 12 23:59:44.246753 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:59:44.250085 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-84ff03d2-2864-4a32-b979-0543215ba3a7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Returning 404 to user: Instance b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5 could not be found. {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:59:44.250085 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-84ff03d2-2864-4a32-b979-0543215ba3a7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5" status: 404 len: 111 microversion: 2.1 time: 0.054688 Sep 12 23:59:44.250085 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 369/733] 10.222.0.26 () {58 vars in 1239 bytes} [Mon Sep 12 23:59:44 2022] DELETE /compute/v2.1/servers/b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:59:44.257185 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-36407ae2-cd1f-4af7-83a7-e70737732914 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:44.258742 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-36407ae2-cd1f-4af7-83a7-e70737732914 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:44.266169 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-36407ae2-cd1f-4af7-83a7-e70737732914 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:44.266746 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-36407ae2-cd1f-4af7-83a7-e70737732914 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:44.267179 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-36407ae2-cd1f-4af7-83a7-e70737732914 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:44.267918 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-36407ae2-cd1f-4af7-83a7-e70737732914 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:44.268390 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-36407ae2-cd1f-4af7-83a7-e70737732914 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:44.268809 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-36407ae2-cd1f-4af7-83a7-e70737732914 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:44.286893 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-36407ae2-cd1f-4af7-83a7-e70737732914 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] HTTP exception thrown: Instance b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5 could not be found. Sep 12 23:59:44.289407 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-36407ae2-cd1f-4af7-83a7-e70737732914 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Request method failure captured: Sep 12 23:59:44.289407 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: request: GET /compute/v2.1/servers/b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5 HTTP/1.1 Sep 12 23:59:44.289407 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Accept: application/json Sep 12 23:59:44.289407 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Sep 12 23:59:44.289407 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Connection: close Sep 12 23:59:44.289407 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Content-Length: 0 Sep 12 23:59:44.289407 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Content-Type: application/json Sep 12 23:59:44.289407 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Host: 10.222.0.26 Sep 12 23:59:44.289407 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Sep 12 23:59:44.289407 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Sep 12 23:59:44.289407 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjH8Z2hSl_dF3G_DVeQeMffC839mjKCX1ldHy7KYxwLbzxfI-Hnili9xft2wG7WgRYfuNYC0jIjSduHyiAWMPed8uo_fiAxdNKw8dFJEFK0lHOKo1_8VeXMUxxHgYF50XY0v_lkkNk_ejqmvpqtZKiNqfO8LXenu9zNmJy4upaAKztdpU Sep 12 23:59:44.289407 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Sep 12 23:59:44.289407 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Sep 12 23:59:44.289407 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Sep 12 23:59:44.289407 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Sep 12 23:59:44.289407 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Sep 12 23:59:44.289407 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Sep 12 23:59:44.289407 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Id: 6c681f1232de4a5fbfc728c230f80624 Sep 12 23:59:44.289407 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-AttachVolumeNegativeTest-1965954712 Sep 12 23:59:44.289407 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Role: member,reader Sep 12 23:59:44.289407 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Roles: member,reader Sep 12 23:59:44.290985 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6c681f1232de4a5fbfc728c230f80624"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6c681f1232de4a5fbfc728c230f80624"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6c681f1232de4a5fbfc728c230f80624"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6c681f1232de4a5fbfc728c230f80624"}]}] Sep 12 23:59:44.290985 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-AttachVolumeNegativeTest-1965954712 Sep 12 23:59:44.290985 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant-Id: 6c681f1232de4a5fbfc728c230f80624 Sep 12 23:59:44.290985 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1965954712 Sep 12 23:59:44.290985 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User: tempest-AttachVolumeNegativeTest-1965954712-project Sep 12 23:59:44.290985 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Sep 12 23:59:44.290985 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Sep 12 23:59:44.290985 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Id: a8cbfc74644f4d4594a70b833ad7002c Sep 12 23:59:44.290985 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-AttachVolumeNegativeTest-1965954712-project Sep 12 23:59:44.290985 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: method: > Sep 12 23:59:44.290985 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: exception: Instance b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5 could not be found. Sep 12 23:59:44.290985 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: action_args: {'id': 'b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5'} Sep 12 23:59:44.291837 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:59:44.291837 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:59:44.291837 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:59:44.291837 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:59:44.291837 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:59:44.291837 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:59:44.291837 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:59:44.291837 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:59:44.291837 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:59:44.291837 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:59:44.291837 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5 could not be found. Sep 12 23:59:44.291837 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:59:44.291837 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:59:44.291837 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:59:44.291837 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:59:44.291837 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:59:44.291837 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:59:44.291837 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:59:44.291837 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:59:44.291837 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:59:44.292978 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:59:44.292978 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 23:59:44.292978 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 23:59:44.292978 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:59:44.292978 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:59:44.292978 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:59:44.292978 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:59:44.292978 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5 could not be found. Sep 12 23:59:44.292978 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:59:44.292978 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:59:44.292978 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:59:44.292978 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:59:44.292978 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:59:44.292978 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:59:44.292978 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:59:44.292978 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:59:44.292978 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5 could not be found. Sep 12 23:59:44.292978 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:59:44.294073 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-36407ae2-cd1f-4af7-83a7-e70737732914 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Returning 404 to user: Instance b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5 could not be found. {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:59:44.294073 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-36407ae2-cd1f-4af7-83a7-e70737732914 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5" status: 404 len: 111 microversion: 2.1 time: 0.040067 Sep 12 23:59:44.294073 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 365/734] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:59:44 2022] GET /compute/v2.1/servers/b0aeeeb8-f72b-4e58-9ea5-3b5c8358c1d5 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:59:44.924066 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-439112a0-56c9-4050-bac2-cbf3d3dfa0aa tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:44.924795 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-439112a0-56c9-4050-bac2-cbf3d3dfa0aa tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] [instance: c94c6c43-ea97-4c2f-a518-1e2c1bb80440] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:44.932678 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-439112a0-56c9-4050-bac2-cbf3d3dfa0aa tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:44.933180 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-439112a0-56c9-4050-bac2-cbf3d3dfa0aa tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:44.933613 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-439112a0-56c9-4050-bac2-cbf3d3dfa0aa tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:44.934346 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-439112a0-56c9-4050-bac2-cbf3d3dfa0aa tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:44.934782 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-439112a0-56c9-4050-bac2-cbf3d3dfa0aa tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:44.935260 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-439112a0-56c9-4050-bac2-cbf3d3dfa0aa tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:45.093329 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-439112a0-56c9-4050-bac2-cbf3d3dfa0aa tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568cea020ffb4b3fa74215dad3c17eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4c43138bd3461fb6d8fa9f924f7e99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:45.102247 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-439112a0-56c9-4050-bac2-cbf3d3dfa0aa tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] 10.222.0.26 "GET /compute/v2.1/servers/c94c6c43-ea97-4c2f-a518-1e2c1bb80440" status: 200 len: 1312 microversion: 2.1 time: 0.182472 Sep 12 23:59:45.103275 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 370/735] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:59:44 2022] GET /compute/v2.1/servers/c94c6c43-ea97-4c2f-a518-1e2c1bb80440 => generated 1312 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:59:45.622109 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7e10e48e-3945-40f6-9313-dca6c716d3ef tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:45.622712 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7e10e48e-3945-40f6-9313-dca6c716d3ef tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: f1ff4faa-6a45-4d62-9e44-80dba7a947c0] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:45.629921 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7e10e48e-3945-40f6-9313-dca6c716d3ef tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:45.630414 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7e10e48e-3945-40f6-9313-dca6c716d3ef tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:45.630842 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7e10e48e-3945-40f6-9313-dca6c716d3ef tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:45.631583 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7e10e48e-3945-40f6-9313-dca6c716d3ef tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:45.632034 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7e10e48e-3945-40f6-9313-dca6c716d3ef tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:45.632454 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7e10e48e-3945-40f6-9313-dca6c716d3ef tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:45.647782 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-7e10e48e-3945-40f6-9313-dca6c716d3ef tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] HTTP exception thrown: Instance f1ff4faa-6a45-4d62-9e44-80dba7a947c0 could not be found. Sep 12 23:59:45.649345 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7e10e48e-3945-40f6-9313-dca6c716d3ef tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Request method failure captured: Sep 12 23:59:45.649345 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: request: DELETE /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0 HTTP/1.1 Sep 12 23:59:45.649345 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Accept: application/json Sep 12 23:59:45.649345 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Sep 12 23:59:45.649345 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Connection: close Sep 12 23:59:45.649345 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Content-Length: 0 Sep 12 23:59:45.649345 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Content-Type: application/json Sep 12 23:59:45.649345 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Host: 10.222.0.26 Sep 12 23:59:45.649345 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Sep 12 23:59:45.649345 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Sep 12 23:59:45.649345 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjH8Z2hSl_dF3G_DVeQeMffC839mjKCX1ldHy7KYxwLbzxfI-Hnili9xft2wG7WgRYfuNYC0jIjSduHyiAWMPed8uo_fiAxdNKw8dFJEFK0lHOKo1_8VeXMUxxHgYF50XY0v_lkkNk_ejqmvpqtZKiNqfO8LXenu9zNmJy4upaAKztdpU Sep 12 23:59:45.649345 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Sep 12 23:59:45.649345 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Sep 12 23:59:45.649345 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Sep 12 23:59:45.649345 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Sep 12 23:59:45.649345 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Sep 12 23:59:45.649345 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Sep 12 23:59:45.649345 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Id: 6c681f1232de4a5fbfc728c230f80624 Sep 12 23:59:45.649345 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-AttachVolumeNegativeTest-1965954712 Sep 12 23:59:45.649345 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Role: member,reader Sep 12 23:59:45.649345 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Roles: member,reader Sep 12 23:59:45.650940 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6c681f1232de4a5fbfc728c230f80624"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6c681f1232de4a5fbfc728c230f80624"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6c681f1232de4a5fbfc728c230f80624"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6c681f1232de4a5fbfc728c230f80624"}]}] Sep 12 23:59:45.650940 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-AttachVolumeNegativeTest-1965954712 Sep 12 23:59:45.650940 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant-Id: 6c681f1232de4a5fbfc728c230f80624 Sep 12 23:59:45.650940 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1965954712 Sep 12 23:59:45.650940 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User: tempest-AttachVolumeNegativeTest-1965954712-project Sep 12 23:59:45.650940 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Sep 12 23:59:45.650940 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Sep 12 23:59:45.650940 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Id: a8cbfc74644f4d4594a70b833ad7002c Sep 12 23:59:45.650940 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-AttachVolumeNegativeTest-1965954712-project Sep 12 23:59:45.650940 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: method: > Sep 12 23:59:45.650940 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: exception: Instance f1ff4faa-6a45-4d62-9e44-80dba7a947c0 could not be found. Sep 12 23:59:45.650940 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: action_args: {'id': 'f1ff4faa-6a45-4d62-9e44-80dba7a947c0'} Sep 12 23:59:45.651882 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:59:45.651882 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:59:45.651882 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:59:45.651882 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:59:45.651882 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:59:45.651882 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:59:45.651882 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:59:45.651882 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:59:45.651882 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:59:45.651882 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:59:45.651882 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1ff4faa-6a45-4d62-9e44-80dba7a947c0 could not be found. Sep 12 23:59:45.651882 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:59:45.651882 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:59:45.651882 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:59:45.651882 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:59:45.651882 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:59:45.651882 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:59:45.651882 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:59:45.651882 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:59:45.651882 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:59:45.653194 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:59:45.653194 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 12 23:59:45.653194 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 12 23:59:45.653194 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 12 23:59:45.653194 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 12 23:59:45.653194 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:59:45.653194 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:59:45.653194 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:59:45.653194 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:59:45.653194 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1ff4faa-6a45-4d62-9e44-80dba7a947c0 could not be found. Sep 12 23:59:45.653194 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:59:45.653194 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:59:45.653194 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:59:45.653194 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:59:45.653194 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:59:45.653194 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:59:45.653194 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:59:45.653194 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:59:45.653194 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1ff4faa-6a45-4d62-9e44-80dba7a947c0 could not be found. Sep 12 23:59:45.653194 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:59:45.654742 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7e10e48e-3945-40f6-9313-dca6c716d3ef tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Returning 404 to user: Instance f1ff4faa-6a45-4d62-9e44-80dba7a947c0 could not be found. {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:59:45.654742 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7e10e48e-3945-40f6-9313-dca6c716d3ef tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0" status: 404 len: 111 microversion: 2.1 time: 0.033351 Sep 12 23:59:45.654742 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 366/736] 10.222.0.26 () {58 vars in 1239 bytes} [Mon Sep 12 23:59:45 2022] DELETE /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:59:45.660579 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-860a88de-953a-4199-a2bb-d3bb4e40f095 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:45.661220 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-860a88de-953a-4199-a2bb-d3bb4e40f095 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: f1ff4faa-6a45-4d62-9e44-80dba7a947c0] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:45.667882 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-860a88de-953a-4199-a2bb-d3bb4e40f095 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:45.668374 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-860a88de-953a-4199-a2bb-d3bb4e40f095 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:45.668846 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-860a88de-953a-4199-a2bb-d3bb4e40f095 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:45.669562 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-860a88de-953a-4199-a2bb-d3bb4e40f095 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:45.670013 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-860a88de-953a-4199-a2bb-d3bb4e40f095 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:45.670432 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-860a88de-953a-4199-a2bb-d3bb4e40f095 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:45.685625 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-860a88de-953a-4199-a2bb-d3bb4e40f095 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] HTTP exception thrown: Instance f1ff4faa-6a45-4d62-9e44-80dba7a947c0 could not be found. Sep 12 23:59:45.687191 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-860a88de-953a-4199-a2bb-d3bb4e40f095 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Request method failure captured: Sep 12 23:59:45.687191 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: request: GET /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0 HTTP/1.1 Sep 12 23:59:45.687191 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept: application/json Sep 12 23:59:45.687191 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Sep 12 23:59:45.687191 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Connection: close Sep 12 23:59:45.687191 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Length: 0 Sep 12 23:59:45.687191 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Type: application/json Sep 12 23:59:45.687191 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Host: 10.222.0.26 Sep 12 23:59:45.687191 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Sep 12 23:59:45.687191 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Sep 12 23:59:45.687191 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjH8Z2hSl_dF3G_DVeQeMffC839mjKCX1ldHy7KYxwLbzxfI-Hnili9xft2wG7WgRYfuNYC0jIjSduHyiAWMPed8uo_fiAxdNKw8dFJEFK0lHOKo1_8VeXMUxxHgYF50XY0v_lkkNk_ejqmvpqtZKiNqfO8LXenu9zNmJy4upaAKztdpU Sep 12 23:59:45.687191 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Sep 12 23:59:45.687191 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Sep 12 23:59:45.687191 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Sep 12 23:59:45.687191 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Sep 12 23:59:45.687191 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Sep 12 23:59:45.687191 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Sep 12 23:59:45.687191 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Id: 6c681f1232de4a5fbfc728c230f80624 Sep 12 23:59:45.687191 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-AttachVolumeNegativeTest-1965954712 Sep 12 23:59:45.687191 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Role: member,reader Sep 12 23:59:45.687191 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Roles: member,reader Sep 12 23:59:45.689581 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6c681f1232de4a5fbfc728c230f80624"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6c681f1232de4a5fbfc728c230f80624"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6c681f1232de4a5fbfc728c230f80624"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6c681f1232de4a5fbfc728c230f80624"}]}] Sep 12 23:59:45.689581 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-AttachVolumeNegativeTest-1965954712 Sep 12 23:59:45.689581 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Id: 6c681f1232de4a5fbfc728c230f80624 Sep 12 23:59:45.689581 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1965954712 Sep 12 23:59:45.689581 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User: tempest-AttachVolumeNegativeTest-1965954712-project Sep 12 23:59:45.689581 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Sep 12 23:59:45.689581 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Sep 12 23:59:45.689581 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Id: a8cbfc74644f4d4594a70b833ad7002c Sep 12 23:59:45.689581 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-AttachVolumeNegativeTest-1965954712-project Sep 12 23:59:45.689581 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: method: > Sep 12 23:59:45.689581 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: exception: Instance f1ff4faa-6a45-4d62-9e44-80dba7a947c0 could not be found. Sep 12 23:59:45.689581 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: action_args: {'id': 'f1ff4faa-6a45-4d62-9e44-80dba7a947c0'} Sep 12 23:59:45.690904 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:59:45.690904 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:59:45.690904 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:59:45.690904 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:59:45.690904 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:59:45.690904 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:59:45.690904 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:59:45.690904 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:59:45.690904 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:59:45.690904 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:59:45.690904 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1ff4faa-6a45-4d62-9e44-80dba7a947c0 could not be found. Sep 12 23:59:45.690904 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:59:45.690904 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:59:45.690904 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:59:45.690904 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:59:45.690904 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:59:45.690904 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:59:45.690904 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:59:45.690904 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:59:45.690904 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:59:45.693503 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:59:45.693503 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 23:59:45.693503 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 23:59:45.693503 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:59:45.693503 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:59:45.693503 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:59:45.693503 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:59:45.693503 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1ff4faa-6a45-4d62-9e44-80dba7a947c0 could not be found. Sep 12 23:59:45.693503 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:59:45.693503 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:59:45.693503 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:59:45.693503 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:59:45.693503 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:59:45.693503 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:59:45.693503 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:59:45.693503 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:59:45.693503 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1ff4faa-6a45-4d62-9e44-80dba7a947c0 could not be found. Sep 12 23:59:45.693503 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:59:45.695953 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-860a88de-953a-4199-a2bb-d3bb4e40f095 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Returning 404 to user: Instance f1ff4faa-6a45-4d62-9e44-80dba7a947c0 could not be found. {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:59:45.695953 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-860a88de-953a-4199-a2bb-d3bb4e40f095 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0" status: 404 len: 111 microversion: 2.1 time: 0.032370 Sep 12 23:59:45.695953 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 371/737] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:59:45 2022] GET /compute/v2.1/servers/f1ff4faa-6a45-4d62-9e44-80dba7a947c0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:59:45.699415 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-69f912bf-bd7c-4a94-afb5-368b9b6088a7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:45.699949 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-69f912bf-bd7c-4a94-afb5-368b9b6088a7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: ad5faa90-b5ff-47e2-abab-21418459ecde] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:45.706405 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-69f912bf-bd7c-4a94-afb5-368b9b6088a7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:45.706894 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-69f912bf-bd7c-4a94-afb5-368b9b6088a7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:45.707357 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-69f912bf-bd7c-4a94-afb5-368b9b6088a7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:45.708073 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-69f912bf-bd7c-4a94-afb5-368b9b6088a7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:45.708527 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-69f912bf-bd7c-4a94-afb5-368b9b6088a7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:45.708947 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-69f912bf-bd7c-4a94-afb5-368b9b6088a7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:45.723644 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-69f912bf-bd7c-4a94-afb5-368b9b6088a7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] HTTP exception thrown: Instance ad5faa90-b5ff-47e2-abab-21418459ecde could not be found. Sep 12 23:59:45.725220 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-69f912bf-bd7c-4a94-afb5-368b9b6088a7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Request method failure captured: Sep 12 23:59:45.725220 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: request: DELETE /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde HTTP/1.1 Sep 12 23:59:45.725220 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Accept: application/json Sep 12 23:59:45.725220 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Sep 12 23:59:45.725220 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Connection: close Sep 12 23:59:45.725220 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Content-Length: 0 Sep 12 23:59:45.725220 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Content-Type: application/json Sep 12 23:59:45.725220 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Host: 10.222.0.26 Sep 12 23:59:45.725220 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Sep 12 23:59:45.725220 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Sep 12 23:59:45.725220 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjH8Z2hSl_dF3G_DVeQeMffC839mjKCX1ldHy7KYxwLbzxfI-Hnili9xft2wG7WgRYfuNYC0jIjSduHyiAWMPed8uo_fiAxdNKw8dFJEFK0lHOKo1_8VeXMUxxHgYF50XY0v_lkkNk_ejqmvpqtZKiNqfO8LXenu9zNmJy4upaAKztdpU Sep 12 23:59:45.725220 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Sep 12 23:59:45.725220 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Sep 12 23:59:45.725220 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Sep 12 23:59:45.725220 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Sep 12 23:59:45.725220 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Sep 12 23:59:45.725220 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Sep 12 23:59:45.725220 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Id: 6c681f1232de4a5fbfc728c230f80624 Sep 12 23:59:45.725220 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-AttachVolumeNegativeTest-1965954712 Sep 12 23:59:45.725220 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Role: member,reader Sep 12 23:59:45.725220 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Roles: member,reader Sep 12 23:59:45.726812 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6c681f1232de4a5fbfc728c230f80624"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6c681f1232de4a5fbfc728c230f80624"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6c681f1232de4a5fbfc728c230f80624"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6c681f1232de4a5fbfc728c230f80624"}]}] Sep 12 23:59:45.726812 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-AttachVolumeNegativeTest-1965954712 Sep 12 23:59:45.726812 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant-Id: 6c681f1232de4a5fbfc728c230f80624 Sep 12 23:59:45.726812 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1965954712 Sep 12 23:59:45.726812 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User: tempest-AttachVolumeNegativeTest-1965954712-project Sep 12 23:59:45.726812 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Sep 12 23:59:45.726812 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Sep 12 23:59:45.726812 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Id: a8cbfc74644f4d4594a70b833ad7002c Sep 12 23:59:45.726812 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-AttachVolumeNegativeTest-1965954712-project Sep 12 23:59:45.726812 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: method: > Sep 12 23:59:45.726812 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: exception: Instance ad5faa90-b5ff-47e2-abab-21418459ecde could not be found. Sep 12 23:59:45.726812 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: action_args: {'id': 'ad5faa90-b5ff-47e2-abab-21418459ecde'} Sep 12 23:59:45.727693 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:59:45.727693 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:59:45.727693 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:59:45.727693 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:59:45.727693 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:59:45.727693 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:59:45.727693 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:59:45.727693 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:59:45.727693 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:59:45.727693 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:59:45.727693 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad5faa90-b5ff-47e2-abab-21418459ecde could not be found. Sep 12 23:59:45.727693 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:59:45.727693 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:59:45.727693 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:59:45.727693 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:59:45.727693 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:59:45.727693 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:59:45.727693 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:59:45.727693 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:59:45.727693 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:59:45.729130 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:59:45.729130 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 12 23:59:45.729130 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 12 23:59:45.729130 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 12 23:59:45.729130 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 12 23:59:45.729130 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:59:45.729130 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:59:45.729130 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:59:45.729130 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:59:45.729130 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad5faa90-b5ff-47e2-abab-21418459ecde could not be found. Sep 12 23:59:45.729130 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:59:45.729130 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:59:45.729130 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:59:45.729130 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:59:45.729130 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:59:45.729130 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:59:45.729130 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:59:45.729130 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:59:45.729130 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad5faa90-b5ff-47e2-abab-21418459ecde could not be found. Sep 12 23:59:45.729130 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:59:45.730615 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-69f912bf-bd7c-4a94-afb5-368b9b6088a7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Returning 404 to user: Instance ad5faa90-b5ff-47e2-abab-21418459ecde could not be found. {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:59:45.730615 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-69f912bf-bd7c-4a94-afb5-368b9b6088a7 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde" status: 404 len: 111 microversion: 2.1 time: 0.032397 Sep 12 23:59:45.730615 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 367/738] 10.222.0.26 () {58 vars in 1239 bytes} [Mon Sep 12 23:59:45 2022] DELETE /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:59:45.739069 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2495511d-217b-4b6f-90e5-d9c4bc16d5d3 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:45.740016 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2495511d-217b-4b6f-90e5-d9c4bc16d5d3 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: ad5faa90-b5ff-47e2-abab-21418459ecde] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:45.748789 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2495511d-217b-4b6f-90e5-d9c4bc16d5d3 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:45.749595 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2495511d-217b-4b6f-90e5-d9c4bc16d5d3 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:45.750218 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2495511d-217b-4b6f-90e5-d9c4bc16d5d3 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:45.751013 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2495511d-217b-4b6f-90e5-d9c4bc16d5d3 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:45.751746 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2495511d-217b-4b6f-90e5-d9c4bc16d5d3 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:45.752341 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2495511d-217b-4b6f-90e5-d9c4bc16d5d3 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:45.774770 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-2495511d-217b-4b6f-90e5-d9c4bc16d5d3 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] HTTP exception thrown: Instance ad5faa90-b5ff-47e2-abab-21418459ecde could not be found. Sep 12 23:59:45.776325 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2495511d-217b-4b6f-90e5-d9c4bc16d5d3 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Request method failure captured: Sep 12 23:59:45.776325 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: request: GET /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde HTTP/1.1 Sep 12 23:59:45.776325 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept: application/json Sep 12 23:59:45.776325 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Sep 12 23:59:45.776325 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Connection: close Sep 12 23:59:45.776325 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Length: 0 Sep 12 23:59:45.776325 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Type: application/json Sep 12 23:59:45.776325 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Host: 10.222.0.26 Sep 12 23:59:45.776325 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Sep 12 23:59:45.776325 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Sep 12 23:59:45.776325 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjH8Z2hSl_dF3G_DVeQeMffC839mjKCX1ldHy7KYxwLbzxfI-Hnili9xft2wG7WgRYfuNYC0jIjSduHyiAWMPed8uo_fiAxdNKw8dFJEFK0lHOKo1_8VeXMUxxHgYF50XY0v_lkkNk_ejqmvpqtZKiNqfO8LXenu9zNmJy4upaAKztdpU Sep 12 23:59:45.776325 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Sep 12 23:59:45.776325 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Sep 12 23:59:45.776325 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Sep 12 23:59:45.776325 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Sep 12 23:59:45.776325 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Sep 12 23:59:45.776325 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Sep 12 23:59:45.776325 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Id: 6c681f1232de4a5fbfc728c230f80624 Sep 12 23:59:45.776325 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-AttachVolumeNegativeTest-1965954712 Sep 12 23:59:45.776325 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Role: member,reader Sep 12 23:59:45.776325 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Roles: member,reader Sep 12 23:59:45.778880 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6c681f1232de4a5fbfc728c230f80624"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6c681f1232de4a5fbfc728c230f80624"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6c681f1232de4a5fbfc728c230f80624"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6c681f1232de4a5fbfc728c230f80624"}]}] Sep 12 23:59:45.778880 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-AttachVolumeNegativeTest-1965954712 Sep 12 23:59:45.778880 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Id: 6c681f1232de4a5fbfc728c230f80624 Sep 12 23:59:45.778880 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1965954712 Sep 12 23:59:45.778880 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User: tempest-AttachVolumeNegativeTest-1965954712-project Sep 12 23:59:45.778880 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Sep 12 23:59:45.778880 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Sep 12 23:59:45.778880 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Id: a8cbfc74644f4d4594a70b833ad7002c Sep 12 23:59:45.778880 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-AttachVolumeNegativeTest-1965954712-project Sep 12 23:59:45.778880 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: method: > Sep 12 23:59:45.778880 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: exception: Instance ad5faa90-b5ff-47e2-abab-21418459ecde could not be found. Sep 12 23:59:45.778880 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: action_args: {'id': 'ad5faa90-b5ff-47e2-abab-21418459ecde'} Sep 12 23:59:45.780535 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:59:45.780535 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:59:45.780535 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:59:45.780535 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:59:45.780535 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:59:45.780535 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:59:45.780535 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:59:45.780535 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:59:45.780535 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:59:45.780535 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:59:45.780535 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad5faa90-b5ff-47e2-abab-21418459ecde could not be found. Sep 12 23:59:45.780535 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:59:45.780535 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:59:45.780535 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:59:45.780535 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:59:45.780535 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:59:45.780535 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:59:45.780535 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:59:45.780535 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:59:45.780535 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:59:45.783272 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:59:45.783272 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 23:59:45.783272 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 23:59:45.783272 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:59:45.783272 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:59:45.783272 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:59:45.783272 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:59:45.783272 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad5faa90-b5ff-47e2-abab-21418459ecde could not be found. Sep 12 23:59:45.783272 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:59:45.783272 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:59:45.783272 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:59:45.783272 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:59:45.783272 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:59:45.783272 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:59:45.783272 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:59:45.783272 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:59:45.783272 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad5faa90-b5ff-47e2-abab-21418459ecde could not be found. Sep 12 23:59:45.783272 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:59:45.784707 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2495511d-217b-4b6f-90e5-d9c4bc16d5d3 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Returning 404 to user: Instance ad5faa90-b5ff-47e2-abab-21418459ecde could not be found. {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:59:45.784707 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2495511d-217b-4b6f-90e5-d9c4bc16d5d3 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde" status: 404 len: 111 microversion: 2.1 time: 0.045644 Sep 12 23:59:45.784707 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 372/739] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:59:45 2022] GET /compute/v2.1/servers/ad5faa90-b5ff-47e2-abab-21418459ecde => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:59:46.140011 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ad75cba0-6954-4d5d-aceb-7d1766025086 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:46.141239 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ad75cba0-6954-4d5d-aceb-7d1766025086 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] [instance: c94c6c43-ea97-4c2f-a518-1e2c1bb80440] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:46.149155 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ad75cba0-6954-4d5d-aceb-7d1766025086 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:46.149649 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ad75cba0-6954-4d5d-aceb-7d1766025086 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:46.150081 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ad75cba0-6954-4d5d-aceb-7d1766025086 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:46.150798 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ad75cba0-6954-4d5d-aceb-7d1766025086 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:46.151290 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ad75cba0-6954-4d5d-aceb-7d1766025086 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:46.151783 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ad75cba0-6954-4d5d-aceb-7d1766025086 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:46.325508 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ad75cba0-6954-4d5d-aceb-7d1766025086 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568cea020ffb4b3fa74215dad3c17eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4c43138bd3461fb6d8fa9f924f7e99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:46.333969 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ad75cba0-6954-4d5d-aceb-7d1766025086 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] 10.222.0.26 "GET /compute/v2.1/servers/c94c6c43-ea97-4c2f-a518-1e2c1bb80440" status: 200 len: 1312 microversion: 2.1 time: 0.200726 Sep 12 23:59:46.334808 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 368/740] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:59:46 2022] GET /compute/v2.1/servers/c94c6c43-ea97-4c2f-a518-1e2c1bb80440 => generated 1312 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:59:46.946834 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4073d101-37bf-424f-929d-b4b1853768df tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:46.947607 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4073d101-37bf-424f-929d-b4b1853768df tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: 1bdd77eb-4b69-4630-9f49-a1d317bb1e12] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:46.954840 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4073d101-37bf-424f-929d-b4b1853768df tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:46.955378 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4073d101-37bf-424f-929d-b4b1853768df tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:46.955817 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4073d101-37bf-424f-929d-b4b1853768df tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:46.956533 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4073d101-37bf-424f-929d-b4b1853768df tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:46.956993 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4073d101-37bf-424f-929d-b4b1853768df tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:46.957412 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4073d101-37bf-424f-929d-b4b1853768df tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:46.973528 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-4073d101-37bf-424f-929d-b4b1853768df tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] HTTP exception thrown: Instance 1bdd77eb-4b69-4630-9f49-a1d317bb1e12 could not be found. Sep 12 23:59:46.975122 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4073d101-37bf-424f-929d-b4b1853768df tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Request method failure captured: Sep 12 23:59:46.975122 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: request: DELETE /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12 HTTP/1.1 Sep 12 23:59:46.975122 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept: application/json Sep 12 23:59:46.975122 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Sep 12 23:59:46.975122 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Connection: close Sep 12 23:59:46.975122 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Length: 0 Sep 12 23:59:46.975122 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Type: application/json Sep 12 23:59:46.975122 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Host: 10.222.0.26 Sep 12 23:59:46.975122 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Sep 12 23:59:46.975122 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Sep 12 23:59:46.975122 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjH8Z2hSl_dF3G_DVeQeMffC839mjKCX1ldHy7KYxwLbzxfI-Hnili9xft2wG7WgRYfuNYC0jIjSduHyiAWMPed8uo_fiAxdNKw8dFJEFK0lHOKo1_8VeXMUxxHgYF50XY0v_lkkNk_ejqmvpqtZKiNqfO8LXenu9zNmJy4upaAKztdpU Sep 12 23:59:46.975122 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Sep 12 23:59:46.975122 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Sep 12 23:59:46.975122 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Sep 12 23:59:46.975122 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Sep 12 23:59:46.975122 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Sep 12 23:59:46.975122 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Sep 12 23:59:46.975122 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Id: 6c681f1232de4a5fbfc728c230f80624 Sep 12 23:59:46.975122 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-AttachVolumeNegativeTest-1965954712 Sep 12 23:59:46.975122 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Role: member,reader Sep 12 23:59:46.975122 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Roles: member,reader Sep 12 23:59:46.977431 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6c681f1232de4a5fbfc728c230f80624"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6c681f1232de4a5fbfc728c230f80624"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6c681f1232de4a5fbfc728c230f80624"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6c681f1232de4a5fbfc728c230f80624"}]}] Sep 12 23:59:46.977431 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-AttachVolumeNegativeTest-1965954712 Sep 12 23:59:46.977431 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Id: 6c681f1232de4a5fbfc728c230f80624 Sep 12 23:59:46.977431 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1965954712 Sep 12 23:59:46.977431 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User: tempest-AttachVolumeNegativeTest-1965954712-project Sep 12 23:59:46.977431 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Sep 12 23:59:46.977431 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Sep 12 23:59:46.977431 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Id: a8cbfc74644f4d4594a70b833ad7002c Sep 12 23:59:46.977431 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-AttachVolumeNegativeTest-1965954712-project Sep 12 23:59:46.977431 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: method: > Sep 12 23:59:46.977431 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: exception: Instance 1bdd77eb-4b69-4630-9f49-a1d317bb1e12 could not be found. Sep 12 23:59:46.977431 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: action_args: {'id': '1bdd77eb-4b69-4630-9f49-a1d317bb1e12'} Sep 12 23:59:46.978982 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:59:46.978982 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:59:46.978982 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:59:46.978982 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:59:46.978982 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:59:46.978982 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:59:46.978982 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:59:46.978982 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:59:46.978982 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:59:46.978982 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:59:46.978982 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bdd77eb-4b69-4630-9f49-a1d317bb1e12 could not be found. Sep 12 23:59:46.978982 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:59:46.978982 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:59:46.978982 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:59:46.978982 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:59:46.978982 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:59:46.978982 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:59:46.978982 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:59:46.978982 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:59:46.978982 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:59:46.981685 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:59:46.981685 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 12 23:59:46.981685 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 12 23:59:46.981685 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 12 23:59:46.981685 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 12 23:59:46.981685 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:59:46.981685 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:59:46.981685 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:59:46.981685 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:59:46.981685 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bdd77eb-4b69-4630-9f49-a1d317bb1e12 could not be found. Sep 12 23:59:46.981685 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:59:46.981685 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:59:46.981685 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:59:46.981685 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:59:46.981685 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:59:46.981685 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:59:46.981685 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:59:46.981685 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:59:46.981685 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bdd77eb-4b69-4630-9f49-a1d317bb1e12 could not be found. Sep 12 23:59:46.981685 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:59:46.983977 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4073d101-37bf-424f-929d-b4b1853768df tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Returning 404 to user: Instance 1bdd77eb-4b69-4630-9f49-a1d317bb1e12 could not be found. {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:59:46.983977 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4073d101-37bf-424f-929d-b4b1853768df tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12" status: 404 len: 111 microversion: 2.1 time: 0.034166 Sep 12 23:59:46.983977 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 373/741] 10.222.0.26 () {58 vars in 1239 bytes} [Mon Sep 12 23:59:46 2022] DELETE /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:59:46.991045 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d2dc2730-689d-4a29-ae37-19d58fa40a88 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:46.992189 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d2dc2730-689d-4a29-ae37-19d58fa40a88 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] [instance: 1bdd77eb-4b69-4630-9f49-a1d317bb1e12] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:47.003760 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d2dc2730-689d-4a29-ae37-19d58fa40a88 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:47.004625 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d2dc2730-689d-4a29-ae37-19d58fa40a88 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:47.005111 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d2dc2730-689d-4a29-ae37-19d58fa40a88 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:47.006376 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d2dc2730-689d-4a29-ae37-19d58fa40a88 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:47.007192 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d2dc2730-689d-4a29-ae37-19d58fa40a88 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:47.007955 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d2dc2730-689d-4a29-ae37-19d58fa40a88 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:47.034375 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-d2dc2730-689d-4a29-ae37-19d58fa40a88 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] HTTP exception thrown: Instance 1bdd77eb-4b69-4630-9f49-a1d317bb1e12 could not be found. Sep 12 23:59:47.037436 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d2dc2730-689d-4a29-ae37-19d58fa40a88 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Request method failure captured: Sep 12 23:59:47.037436 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: request: GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12 HTTP/1.1 Sep 12 23:59:47.037436 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Accept: application/json Sep 12 23:59:47.037436 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Sep 12 23:59:47.037436 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Connection: close Sep 12 23:59:47.037436 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Content-Length: 0 Sep 12 23:59:47.037436 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Content-Type: application/json Sep 12 23:59:47.037436 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Host: 10.222.0.26 Sep 12 23:59:47.037436 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Sep 12 23:59:47.037436 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Sep 12 23:59:47.037436 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjH8Z2hSl_dF3G_DVeQeMffC839mjKCX1ldHy7KYxwLbzxfI-Hnili9xft2wG7WgRYfuNYC0jIjSduHyiAWMPed8uo_fiAxdNKw8dFJEFK0lHOKo1_8VeXMUxxHgYF50XY0v_lkkNk_ejqmvpqtZKiNqfO8LXenu9zNmJy4upaAKztdpU Sep 12 23:59:47.037436 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Sep 12 23:59:47.037436 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Sep 12 23:59:47.037436 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Sep 12 23:59:47.037436 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Sep 12 23:59:47.037436 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Sep 12 23:59:47.037436 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Sep 12 23:59:47.037436 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Id: 6c681f1232de4a5fbfc728c230f80624 Sep 12 23:59:47.037436 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-AttachVolumeNegativeTest-1965954712 Sep 12 23:59:47.037436 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Role: member,reader Sep 12 23:59:47.037436 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Roles: member,reader Sep 12 23:59:47.039777 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6c681f1232de4a5fbfc728c230f80624"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6c681f1232de4a5fbfc728c230f80624"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6c681f1232de4a5fbfc728c230f80624"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6c681f1232de4a5fbfc728c230f80624"}]}] Sep 12 23:59:47.039777 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-AttachVolumeNegativeTest-1965954712 Sep 12 23:59:47.039777 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant-Id: 6c681f1232de4a5fbfc728c230f80624 Sep 12 23:59:47.039777 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1965954712 Sep 12 23:59:47.039777 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User: tempest-AttachVolumeNegativeTest-1965954712-project Sep 12 23:59:47.039777 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Sep 12 23:59:47.039777 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Sep 12 23:59:47.039777 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Id: a8cbfc74644f4d4594a70b833ad7002c Sep 12 23:59:47.039777 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-AttachVolumeNegativeTest-1965954712-project Sep 12 23:59:47.039777 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: method: > Sep 12 23:59:47.039777 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: exception: Instance 1bdd77eb-4b69-4630-9f49-a1d317bb1e12 could not be found. Sep 12 23:59:47.039777 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: action_args: {'id': '1bdd77eb-4b69-4630-9f49-a1d317bb1e12'} Sep 12 23:59:47.041164 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:59:47.041164 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:59:47.041164 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:59:47.041164 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:59:47.041164 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:59:47.041164 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:59:47.041164 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:59:47.041164 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:59:47.041164 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:59:47.041164 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:59:47.041164 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bdd77eb-4b69-4630-9f49-a1d317bb1e12 could not be found. Sep 12 23:59:47.041164 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:59:47.041164 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:59:47.041164 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:59:47.041164 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:59:47.041164 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:59:47.041164 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:59:47.041164 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:59:47.041164 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:59:47.041164 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:59:47.043061 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:59:47.043061 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 23:59:47.043061 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 23:59:47.043061 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:59:47.043061 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:59:47.043061 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:59:47.043061 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:59:47.043061 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bdd77eb-4b69-4630-9f49-a1d317bb1e12 could not be found. Sep 12 23:59:47.043061 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:59:47.043061 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:59:47.043061 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:59:47.043061 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:59:47.043061 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:59:47.043061 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:59:47.043061 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:59:47.043061 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:59:47.043061 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bdd77eb-4b69-4630-9f49-a1d317bb1e12 could not be found. Sep 12 23:59:47.043061 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 12 23:59:47.044557 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d2dc2730-689d-4a29-ae37-19d58fa40a88 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] Returning 404 to user: Instance 1bdd77eb-4b69-4630-9f49-a1d317bb1e12 could not be found. {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:59:47.044557 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d2dc2730-689d-4a29-ae37-19d58fa40a88 tempest-AttachVolumeNegativeTest-1965954712 tempest-AttachVolumeNegativeTest-1965954712-project] 10.222.0.26 "GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12" status: 404 len: 111 microversion: 2.1 time: 0.056063 Sep 12 23:59:47.044557 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 369/742] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:59:46 2022] GET /compute/v2.1/servers/1bdd77eb-4b69-4630-9f49-a1d317bb1e12 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:59:47.358771 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-bdfa5169-37df-4aed-92fb-56704a16fc7f tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:47.359747 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-bdfa5169-37df-4aed-92fb-56704a16fc7f tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] [instance: c94c6c43-ea97-4c2f-a518-1e2c1bb80440] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:47.367686 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bdfa5169-37df-4aed-92fb-56704a16fc7f tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:47.368332 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bdfa5169-37df-4aed-92fb-56704a16fc7f tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:47.368957 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bdfa5169-37df-4aed-92fb-56704a16fc7f tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:47.369841 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bdfa5169-37df-4aed-92fb-56704a16fc7f tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:47.370415 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bdfa5169-37df-4aed-92fb-56704a16fc7f tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:47.370947 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bdfa5169-37df-4aed-92fb-56704a16fc7f tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:47.799791 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-bdfa5169-37df-4aed-92fb-56704a16fc7f tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568cea020ffb4b3fa74215dad3c17eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4c43138bd3461fb6d8fa9f924f7e99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:47.810306 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-bdfa5169-37df-4aed-92fb-56704a16fc7f tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] 10.222.0.26 "GET /compute/v2.1/servers/c94c6c43-ea97-4c2f-a518-1e2c1bb80440" status: 200 len: 1497 microversion: 2.1 time: 0.455731 Sep 12 23:59:47.811090 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 374/743] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:59:47 2022] GET /compute/v2.1/servers/c94c6c43-ea97-4c2f-a518-1e2c1bb80440 => generated 1497 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:59:48.403720 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-44110b67-63dd-47df-8d87-aa67eb3e75dc tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:48.404558 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-44110b67-63dd-47df-8d87-aa67eb3e75dc tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] [instance: c94c6c43-ea97-4c2f-a518-1e2c1bb80440] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:48.417740 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-44110b67-63dd-47df-8d87-aa67eb3e75dc tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:48.418663 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-44110b67-63dd-47df-8d87-aa67eb3e75dc tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:48.419479 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-44110b67-63dd-47df-8d87-aa67eb3e75dc tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:48.421043 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-44110b67-63dd-47df-8d87-aa67eb3e75dc tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:48.422112 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-44110b67-63dd-47df-8d87-aa67eb3e75dc tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:48.422893 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-44110b67-63dd-47df-8d87-aa67eb3e75dc tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:48.475799 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-44110b67-63dd-47df-8d87-aa67eb3e75dc tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] [instance: c94c6c43-ea97-4c2f-a518-1e2c1bb80440] Going to try to terminate instance {{(pid=126976) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 12 23:59:48.619628 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-44110b67-63dd-47df-8d87-aa67eb3e75dc tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c94c6c43-ea97-4c2f-a518-1e2c1bb80440" status: 204 len: 0 microversion: 2.1 time: 0.223160 Sep 12 23:59:48.620939 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 370/744] 10.222.0.26 () {58 vars in 1239 bytes} [Mon Sep 12 23:59:48 2022] DELETE /compute/v2.1/servers/c94c6c43-ea97-4c2f-a518-1e2c1bb80440 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 12 23:59:48.636422 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d8b9dd69-bd0e-4d3e-98f7-a9c3722ff3a5 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:48.638842 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d8b9dd69-bd0e-4d3e-98f7-a9c3722ff3a5 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] [instance: c94c6c43-ea97-4c2f-a518-1e2c1bb80440] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:48.651282 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d8b9dd69-bd0e-4d3e-98f7-a9c3722ff3a5 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:48.652244 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d8b9dd69-bd0e-4d3e-98f7-a9c3722ff3a5 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:48.653113 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d8b9dd69-bd0e-4d3e-98f7-a9c3722ff3a5 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:48.654476 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d8b9dd69-bd0e-4d3e-98f7-a9c3722ff3a5 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:48.655320 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d8b9dd69-bd0e-4d3e-98f7-a9c3722ff3a5 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:48.656446 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d8b9dd69-bd0e-4d3e-98f7-a9c3722ff3a5 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:48.906449 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d8b9dd69-bd0e-4d3e-98f7-a9c3722ff3a5 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568cea020ffb4b3fa74215dad3c17eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4c43138bd3461fb6d8fa9f924f7e99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:48.919084 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d8b9dd69-bd0e-4d3e-98f7-a9c3722ff3a5 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] 10.222.0.26 "GET /compute/v2.1/servers/c94c6c43-ea97-4c2f-a518-1e2c1bb80440" status: 200 len: 1503 microversion: 2.1 time: 0.290660 Sep 12 23:59:48.920103 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 375/745] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:59:48 2022] GET /compute/v2.1/servers/c94c6c43-ea97-4c2f-a518-1e2c1bb80440 => generated 1503 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:59:49.947446 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e3027c51-d04a-476c-9d1c-d95108d24ac0 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:49.948289 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e3027c51-d04a-476c-9d1c-d95108d24ac0 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] [instance: c94c6c43-ea97-4c2f-a518-1e2c1bb80440] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:49.956096 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3027c51-d04a-476c-9d1c-d95108d24ac0 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:49.956834 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3027c51-d04a-476c-9d1c-d95108d24ac0 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:49.957306 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3027c51-d04a-476c-9d1c-d95108d24ac0 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:49.958114 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3027c51-d04a-476c-9d1c-d95108d24ac0 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:49.958535 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3027c51-d04a-476c-9d1c-d95108d24ac0 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:49.959061 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3027c51-d04a-476c-9d1c-d95108d24ac0 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:50.323298 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e3027c51-d04a-476c-9d1c-d95108d24ac0 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568cea020ffb4b3fa74215dad3c17eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4c43138bd3461fb6d8fa9f924f7e99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:50.342739 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e3027c51-d04a-476c-9d1c-d95108d24ac0 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] 10.222.0.26 "GET /compute/v2.1/servers/c94c6c43-ea97-4c2f-a518-1e2c1bb80440" status: 200 len: 1503 microversion: 2.1 time: 0.399225 Sep 12 23:59:50.344109 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 371/746] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:59:49 2022] GET /compute/v2.1/servers/c94c6c43-ea97-4c2f-a518-1e2c1bb80440 => generated 1503 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 12 23:59:51.317680 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-823abfac-93f8-4ddc-bee2-25a75d915c58 req-1c17740e-41eb-41b3-9246-694f7b6ad322 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c94c6c43-ea97-4c2f-a518-1e2c1bb80440", "name": "network-vif-deleted", "tag": "11b2be14-8993-40cd-b022-a16de185f5a0"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:59:51.343866 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-823abfac-93f8-4ddc-bee2-25a75d915c58 req-1c17740e-41eb-41b3-9246-694f7b6ad322 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:51.345372 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-823abfac-93f8-4ddc-bee2-25a75d915c58 req-1c17740e-41eb-41b3-9246-694f7b6ad322 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:51.345996 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-823abfac-93f8-4ddc-bee2-25a75d915c58 req-1c17740e-41eb-41b3-9246-694f7b6ad322 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:51.372126 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-823abfac-93f8-4ddc-bee2-25a75d915c58 req-1c17740e-41eb-41b3-9246-694f7b6ad322 service nova] Creating event network-vif-deleted:11b2be14-8993-40cd-b022-a16de185f5a0 for instance c94c6c43-ea97-4c2f-a518-1e2c1bb80440 on hv-cinder-82002 Sep 12 23:59:51.388516 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-bd6e9a40-dc8b-4390-8c7a-09062ba90b4a tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:51.390650 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-bd6e9a40-dc8b-4390-8c7a-09062ba90b4a tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] [instance: c94c6c43-ea97-4c2f-a518-1e2c1bb80440] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:51.403972 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-823abfac-93f8-4ddc-bee2-25a75d915c58 req-1c17740e-41eb-41b3-9246-694f7b6ad322 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092271 Sep 12 23:59:51.404629 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 376/747] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 12 23:59:51.414322 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd6e9a40-dc8b-4390-8c7a-09062ba90b4a tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:51.415152 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd6e9a40-dc8b-4390-8c7a-09062ba90b4a tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:51.416231 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd6e9a40-dc8b-4390-8c7a-09062ba90b4a tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:51.418693 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd6e9a40-dc8b-4390-8c7a-09062ba90b4a tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:51.419855 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd6e9a40-dc8b-4390-8c7a-09062ba90b4a tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:51.420812 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd6e9a40-dc8b-4390-8c7a-09062ba90b4a tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:51.567359 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-bd6e9a40-dc8b-4390-8c7a-09062ba90b4a tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568cea020ffb4b3fa74215dad3c17eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4c43138bd3461fb6d8fa9f924f7e99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:51.581447 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-bd6e9a40-dc8b-4390-8c7a-09062ba90b4a tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] 10.222.0.26 "GET /compute/v2.1/servers/c94c6c43-ea97-4c2f-a518-1e2c1bb80440" status: 200 len: 1297 microversion: 2.1 time: 0.199447 Sep 12 23:59:51.582706 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 372/748] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:59:51 2022] GET /compute/v2.1/servers/c94c6c43-ea97-4c2f-a518-1e2c1bb80440 => generated 1297 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:59:52.620827 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-07b9d645-1af4-4046-b4bd-09f5d325180a tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:52.622052 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-07b9d645-1af4-4046-b4bd-09f5d325180a tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] [instance: c94c6c43-ea97-4c2f-a518-1e2c1bb80440] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:52.634343 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-07b9d645-1af4-4046-b4bd-09f5d325180a tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:52.635180 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-07b9d645-1af4-4046-b4bd-09f5d325180a tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:52.635972 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-07b9d645-1af4-4046-b4bd-09f5d325180a tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:52.637259 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-07b9d645-1af4-4046-b4bd-09f5d325180a tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:52.638099 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-07b9d645-1af4-4046-b4bd-09f5d325180a tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:52.638990 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-07b9d645-1af4-4046-b4bd-09f5d325180a tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:52.660382 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-07b9d645-1af4-4046-b4bd-09f5d325180a tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] HTTP exception thrown: Instance c94c6c43-ea97-4c2f-a518-1e2c1bb80440 could not be found. Sep 12 23:59:52.662345 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-07b9d645-1af4-4046-b4bd-09f5d325180a tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Request method failure captured: Sep 12 23:59:52.662345 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: request: GET /compute/v2.1/servers/c94c6c43-ea97-4c2f-a518-1e2c1bb80440 HTTP/1.1 Sep 12 23:59:52.662345 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept: application/json Sep 12 23:59:52.662345 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Sep 12 23:59:52.662345 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Connection: close Sep 12 23:59:52.662345 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Length: 0 Sep 12 23:59:52.662345 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Type: application/json Sep 12 23:59:52.662345 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Host: 10.222.0.26 Sep 12 23:59:52.662345 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Sep 12 23:59:52.662345 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Sep 12 23:59:52.662345 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjH8fjZGPAdnUFlfOIcabYYu4a1f8nYEPg4zabH61Jwq2-IHcV01eyEiSJ5g8t8QNdx-Imlpt-KWdxOoncda0oFRLIOTBBdF5HYdXtMSu2gY8sp023XPINQEli32bHvC_ePukZfg14w1tlV8G9mEWsLYo8utWQ-1An7xD5b-9c98LJMic Sep 12 23:59:52.662345 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Sep 12 23:59:52.662345 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Sep 12 23:59:52.662345 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Sep 12 23:59:52.662345 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Sep 12 23:59:52.662345 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Sep 12 23:59:52.662345 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Sep 12 23:59:52.662345 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Id: 0d4c43138bd3461fb6d8fa9f924f7e99 Sep 12 23:59:52.662345 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-VolumesActionsTest-76163484 Sep 12 23:59:52.662345 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Role: member,reader Sep 12 23:59:52.662345 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Roles: member,reader Sep 12 23:59:52.665065 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0d4c43138bd3461fb6d8fa9f924f7e99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0d4c43138bd3461fb6d8fa9f924f7e99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0d4c43138bd3461fb6d8fa9f924f7e99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0d4c43138bd3461fb6d8fa9f924f7e99"}]}] Sep 12 23:59:52.665065 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-VolumesActionsTest-76163484 Sep 12 23:59:52.665065 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Id: 0d4c43138bd3461fb6d8fa9f924f7e99 Sep 12 23:59:52.665065 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-VolumesActionsTest-76163484 Sep 12 23:59:52.665065 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User: tempest-VolumesActionsTest-76163484-project Sep 12 23:59:52.665065 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Sep 12 23:59:52.665065 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Sep 12 23:59:52.665065 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Id: 568cea020ffb4b3fa74215dad3c17eba Sep 12 23:59:52.665065 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-VolumesActionsTest-76163484-project Sep 12 23:59:52.665065 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: method: > Sep 12 23:59:52.665065 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: exception: Instance c94c6c43-ea97-4c2f-a518-1e2c1bb80440 could not be found. Sep 12 23:59:52.665065 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: action_args: {'id': 'c94c6c43-ea97-4c2f-a518-1e2c1bb80440'} Sep 12 23:59:52.666512 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 12 23:59:52.666512 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:59:52.666512 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 12 23:59:52.666512 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 12 23:59:52.666512 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 12 23:59:52.666512 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 12 23:59:52.666512 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 12 23:59:52.666512 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 12 23:59:52.666512 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 12 23:59:52.666512 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 12 23:59:52.666512 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c94c6c43-ea97-4c2f-a518-1e2c1bb80440 could not be found. Sep 12 23:59:52.666512 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:59:52.666512 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:59:52.666512 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:59:52.666512 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:59:52.666512 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:59:52.666512 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:59:52.666512 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 12 23:59:52.666512 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 12 23:59:52.666512 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 12 23:59:52.668655 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 12 23:59:52.668655 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 12 23:59:52.668655 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 12 23:59:52.668655 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 12 23:59:52.668655 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 12 23:59:52.668655 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 12 23:59:52.668655 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 12 23:59:52.668655 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c94c6c43-ea97-4c2f-a518-1e2c1bb80440 could not be found. Sep 12 23:59:52.668655 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:59:52.668655 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 12 23:59:52.668655 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:59:52.668655 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 12 23:59:52.668655 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 12 23:59:52.668655 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 12 23:59:52.668655 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 12 23:59:52.668655 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 12 23:59:52.668655 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c94c6c43-ea97-4c2f-a518-1e2c1bb80440 could not be found. Sep 12 23:59:52.668655 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 12 23:59:52.670737 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-07b9d645-1af4-4046-b4bd-09f5d325180a tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Returning 404 to user: Instance c94c6c43-ea97-4c2f-a518-1e2c1bb80440 could not be found. {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 12 23:59:52.670737 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-07b9d645-1af4-4046-b4bd-09f5d325180a tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] 10.222.0.26 "GET /compute/v2.1/servers/c94c6c43-ea97-4c2f-a518-1e2c1bb80440" status: 404 len: 111 microversion: 2.1 time: 0.051441 Sep 12 23:59:52.670737 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 377/749] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:59:52 2022] GET /compute/v2.1/servers/c94c6c43-ea97-4c2f-a518-1e2c1bb80440 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 12 23:59:52.828597 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d4f7057e-7dc2-4862-a14d-94fe6f43d28a tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1805822349", "imageRef": "22a47167-5e04-441a-a504-d76d82afc776", "flavorRef": "452", "networks": [{"uuid": "f3192aa0-69b1-4ced-9ab8-c4310d0134eb"}]}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:59:52.923279 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.network.neutron [None req-d4f7057e-7dc2-4862-a14d-94fe6f43d28a tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] validate_networks() for [('f3192aa0-69b1-4ced-9ab8-c4310d0134eb', None, None, None, None, None)] {{(pid=126976) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 12 23:59:53.695237 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-d4f7057e-7dc2-4862-a14d-94fe6f43d28a tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Flavor limits 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 12 23:59:53.695934 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-d4f7057e-7dc2-4862-a14d-94fe6f43d28a tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Image limits 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 12 23:59:53.696486 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-d4f7057e-7dc2-4862-a14d-94fe6f43d28a tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Flavor pref 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 12 23:59:53.697039 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-d4f7057e-7dc2-4862-a14d-94fe6f43d28a tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Image pref 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 12 23:59:53.697801 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-d4f7057e-7dc2-4862-a14d-94fe6f43d28a tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 12 23:59:53.709153 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d4f7057e-7dc2-4862-a14d-94fe6f43d28a tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:53.709663 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d4f7057e-7dc2-4862-a14d-94fe6f43d28a tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:53.710301 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d4f7057e-7dc2-4862-a14d-94fe6f43d28a tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:53.711266 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d4f7057e-7dc2-4862-a14d-94fe6f43d28a tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:53.712081 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d4f7057e-7dc2-4862-a14d-94fe6f43d28a tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:53.712535 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d4f7057e-7dc2-4862-a14d-94fe6f43d28a tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:53.738591 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-d4f7057e-7dc2-4862-a14d-94fe6f43d28a tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Getting quotas for project 0d4c43138bd3461fb6d8fa9f924f7e99. Resources: {'instances', 'cores', 'ram'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 12 23:59:53.746386 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-d4f7057e-7dc2-4862-a14d-94fe6f43d28a tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Getting quotas for user 568cea020ffb4b3fa74215dad3c17eba and project 0d4c43138bd3461fb6d8fa9f924f7e99. Resources: {'instances', 'cores', 'ram'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 12 23:59:53.764513 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d4f7057e-7dc2-4862-a14d-94fe6f43d28a tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Going to run 1 instances... {{(pid=126976) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 12 23:59:53.768462 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d4f7057e-7dc2-4862-a14d-94fe6f43d28a tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] [instance: f58cf737-d9d1-48ce-9832-dbb0b15bbbab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='22a47167-5e04-441a-a504-d76d82afc776',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126976) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 12 23:59:53.835806 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d4f7057e-7dc2-4862-a14d-94fe6f43d28a tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.014961 Sep 12 23:59:53.837181 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 373/750] 10.222.0.26 () {60 vars in 1147 bytes} [Mon Sep 12 23:59:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1017 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 12 23:59:53.851702 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0041aa5a-3870-4467-8899-fa24d4341e85 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:53.852635 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0041aa5a-3870-4467-8899-fa24d4341e85 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] [instance: f58cf737-d9d1-48ce-9832-dbb0b15bbbab] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:53.934483 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0041aa5a-3870-4467-8899-fa24d4341e85 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568cea020ffb4b3fa74215dad3c17eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4c43138bd3461fb6d8fa9f924f7e99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:53.949448 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0041aa5a-3870-4467-8899-fa24d4341e85 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] 10.222.0.26 "GET /compute/v2.1/servers/f58cf737-d9d1-48ce-9832-dbb0b15bbbab" status: 200 len: 1214 microversion: 2.1 time: 0.103682 Sep 12 23:59:53.950811 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 378/751] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:59:53 2022] GET /compute/v2.1/servers/f58cf737-d9d1-48ce-9832-dbb0b15bbbab => generated 1214 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:59:54.973429 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a28b4b77-4b13-4e9c-8aca-8b9e080f5ab2 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:54.974209 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a28b4b77-4b13-4e9c-8aca-8b9e080f5ab2 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] [instance: f58cf737-d9d1-48ce-9832-dbb0b15bbbab] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:54.982392 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a28b4b77-4b13-4e9c-8aca-8b9e080f5ab2 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:54.982869 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a28b4b77-4b13-4e9c-8aca-8b9e080f5ab2 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:54.983356 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a28b4b77-4b13-4e9c-8aca-8b9e080f5ab2 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:54.984158 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a28b4b77-4b13-4e9c-8aca-8b9e080f5ab2 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:54.984634 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a28b4b77-4b13-4e9c-8aca-8b9e080f5ab2 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:54.985056 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a28b4b77-4b13-4e9c-8aca-8b9e080f5ab2 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:55.076754 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a28b4b77-4b13-4e9c-8aca-8b9e080f5ab2 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568cea020ffb4b3fa74215dad3c17eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4c43138bd3461fb6d8fa9f924f7e99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:55.090160 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a28b4b77-4b13-4e9c-8aca-8b9e080f5ab2 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] 10.222.0.26 "GET /compute/v2.1/servers/f58cf737-d9d1-48ce-9832-dbb0b15bbbab" status: 200 len: 1266 microversion: 2.1 time: 0.120494 Sep 12 23:59:55.091112 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 374/752] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:59:54 2022] GET /compute/v2.1/servers/f58cf737-d9d1-48ce-9832-dbb0b15bbbab => generated 1266 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:59:56.126415 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c12a5cf7-f51f-49d5-b42a-75bb41975120 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:56.127100 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c12a5cf7-f51f-49d5-b42a-75bb41975120 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] [instance: f58cf737-d9d1-48ce-9832-dbb0b15bbbab] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:56.135446 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c12a5cf7-f51f-49d5-b42a-75bb41975120 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:56.135944 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c12a5cf7-f51f-49d5-b42a-75bb41975120 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:56.136375 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c12a5cf7-f51f-49d5-b42a-75bb41975120 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:56.137090 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c12a5cf7-f51f-49d5-b42a-75bb41975120 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:56.137536 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c12a5cf7-f51f-49d5-b42a-75bb41975120 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:56.138156 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c12a5cf7-f51f-49d5-b42a-75bb41975120 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:56.300508 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c12a5cf7-f51f-49d5-b42a-75bb41975120 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568cea020ffb4b3fa74215dad3c17eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4c43138bd3461fb6d8fa9f924f7e99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:56.308893 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c12a5cf7-f51f-49d5-b42a-75bb41975120 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] 10.222.0.26 "GET /compute/v2.1/servers/f58cf737-d9d1-48ce-9832-dbb0b15bbbab" status: 200 len: 1314 microversion: 2.1 time: 0.186573 Sep 12 23:59:56.309479 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 379/753] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:59:56 2022] GET /compute/v2.1/servers/f58cf737-d9d1-48ce-9832-dbb0b15bbbab => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:59:57.333434 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c865fa59-094f-4a19-b320-ff556b67bac0 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:57.334120 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c865fa59-094f-4a19-b320-ff556b67bac0 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] [instance: f58cf737-d9d1-48ce-9832-dbb0b15bbbab] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:57.336707 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 12 23:59:57.342745 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c865fa59-094f-4a19-b320-ff556b67bac0 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:57.343279 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c865fa59-094f-4a19-b320-ff556b67bac0 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:57.343820 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c865fa59-094f-4a19-b320-ff556b67bac0 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:57.344519 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c865fa59-094f-4a19-b320-ff556b67bac0 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:57.344972 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c865fa59-094f-4a19-b320-ff556b67bac0 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:57.345393 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c865fa59-094f-4a19-b320-ff556b67bac0 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:57.502532 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c865fa59-094f-4a19-b320-ff556b67bac0 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568cea020ffb4b3fa74215dad3c17eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4c43138bd3461fb6d8fa9f924f7e99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:57.515641 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c865fa59-094f-4a19-b320-ff556b67bac0 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] 10.222.0.26 "GET /compute/v2.1/servers/f58cf737-d9d1-48ce-9832-dbb0b15bbbab" status: 200 len: 1314 microversion: 2.1 time: 0.185859 Sep 12 23:59:57.516659 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 375/754] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:59:57 2022] GET /compute/v2.1/servers/f58cf737-d9d1-48ce-9832-dbb0b15bbbab => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:59:58.539987 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7ae4205f-e55a-4a04-aee1-54d6a424083c tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:58.540615 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7ae4205f-e55a-4a04-aee1-54d6a424083c tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] [instance: f58cf737-d9d1-48ce-9832-dbb0b15bbbab] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:58.548020 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ae4205f-e55a-4a04-aee1-54d6a424083c tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:58.548546 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ae4205f-e55a-4a04-aee1-54d6a424083c tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:58.548980 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ae4205f-e55a-4a04-aee1-54d6a424083c tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:58.549696 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ae4205f-e55a-4a04-aee1-54d6a424083c tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:58.550152 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ae4205f-e55a-4a04-aee1-54d6a424083c tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:58.550568 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7ae4205f-e55a-4a04-aee1-54d6a424083c tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:58.748094 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7ae4205f-e55a-4a04-aee1-54d6a424083c tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568cea020ffb4b3fa74215dad3c17eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4c43138bd3461fb6d8fa9f924f7e99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 12 23:59:58.761694 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7ae4205f-e55a-4a04-aee1-54d6a424083c tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] 10.222.0.26 "GET /compute/v2.1/servers/f58cf737-d9d1-48ce-9832-dbb0b15bbbab" status: 200 len: 1314 microversion: 2.1 time: 0.225362 Sep 12 23:59:58.762644 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 380/755] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:59:58 2022] GET /compute/v2.1/servers/f58cf737-d9d1-48ce-9832-dbb0b15bbbab => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 12 23:59:58.777355 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-8b4acb87-43d6-4752-8b6d-92f79e1ac27e req-e38d0df5-75a8-4e9a-ac93-4afc760c1ccf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f58cf737-d9d1-48ce-9832-dbb0b15bbbab", "tag": "8fae5321-fecc-48b6-a52f-4b9969027ab1"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 12 23:59:58.788259 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-8b4acb87-43d6-4752-8b6d-92f79e1ac27e req-e38d0df5-75a8-4e9a-ac93-4afc760c1ccf service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:58.788691 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-8b4acb87-43d6-4752-8b6d-92f79e1ac27e req-e38d0df5-75a8-4e9a-ac93-4afc760c1ccf service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:58.789349 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-8b4acb87-43d6-4752-8b6d-92f79e1ac27e req-e38d0df5-75a8-4e9a-ac93-4afc760c1ccf service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:58.800857 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-8b4acb87-43d6-4752-8b6d-92f79e1ac27e req-e38d0df5-75a8-4e9a-ac93-4afc760c1ccf service nova] Creating event network-changed:8fae5321-fecc-48b6-a52f-4b9969027ab1 for instance f58cf737-d9d1-48ce-9832-dbb0b15bbbab on hv-cinder-82002 Sep 12 23:59:58.805987 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-8b4acb87-43d6-4752-8b6d-92f79e1ac27e req-e38d0df5-75a8-4e9a-ac93-4afc760c1ccf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032323 Sep 12 23:59:58.806607 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 376/756] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Sep 12 23:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 12 23:59:59.797456 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a6d2ede3-5be1-4a70-a66b-caaac9610489 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 12 23:59:59.798027 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a6d2ede3-5be1-4a70-a66b-caaac9610489 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] [instance: f58cf737-d9d1-48ce-9832-dbb0b15bbbab] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 12 23:59:59.804972 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a6d2ede3-5be1-4a70-a66b-caaac9610489 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:59.805460 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a6d2ede3-5be1-4a70-a66b-caaac9610489 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:59.805905 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a6d2ede3-5be1-4a70-a66b-caaac9610489 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:59.806655 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a6d2ede3-5be1-4a70-a66b-caaac9610489 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 12 23:59:59.807140 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a6d2ede3-5be1-4a70-a66b-caaac9610489 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 12 23:59:59.807614 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a6d2ede3-5be1-4a70-a66b-caaac9610489 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 12 23:59:59.998587 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a6d2ede3-5be1-4a70-a66b-caaac9610489 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568cea020ffb4b3fa74215dad3c17eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4c43138bd3461fb6d8fa9f924f7e99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:00:00.008324 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a6d2ede3-5be1-4a70-a66b-caaac9610489 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] 10.222.0.26 "GET /compute/v2.1/servers/f58cf737-d9d1-48ce-9832-dbb0b15bbbab" status: 200 len: 1314 microversion: 2.1 time: 0.214688 Sep 13 00:00:00.008889 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 381/757] 10.222.0.26 () {58 vars in 1236 bytes} [Mon Sep 12 23:59:59 2022] GET /compute/v2.1/servers/f58cf737-d9d1-48ce-9832-dbb0b15bbbab => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:00:01.036913 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8228b6d5-4865-4b85-862e-c8899792f315 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:00:01.037519 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-8228b6d5-4865-4b85-862e-c8899792f315 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] [instance: f58cf737-d9d1-48ce-9832-dbb0b15bbbab] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:00:01.045409 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8228b6d5-4865-4b85-862e-c8899792f315 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:01.045972 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8228b6d5-4865-4b85-862e-c8899792f315 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:01.046403 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8228b6d5-4865-4b85-862e-c8899792f315 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:01.047250 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8228b6d5-4865-4b85-862e-c8899792f315 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:01.047741 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8228b6d5-4865-4b85-862e-c8899792f315 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:01.048166 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8228b6d5-4865-4b85-862e-c8899792f315 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:01.051507 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:01.199731 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8228b6d5-4865-4b85-862e-c8899792f315 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568cea020ffb4b3fa74215dad3c17eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4c43138bd3461fb6d8fa9f924f7e99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:00:01.215524 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-8228b6d5-4865-4b85-862e-c8899792f315 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] 10.222.0.26 "GET /compute/v2.1/servers/f58cf737-d9d1-48ce-9832-dbb0b15bbbab" status: 200 len: 1314 microversion: 2.1 time: 0.183306 Sep 13 00:00:01.216140 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 377/758] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:00:01 2022] GET /compute/v2.1/servers/f58cf737-d9d1-48ce-9832-dbb0b15bbbab => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:00:02.239167 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ac5c8ef0-acc1-4746-95ae-e862f56dc995 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:00:02.239912 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ac5c8ef0-acc1-4746-95ae-e862f56dc995 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] [instance: f58cf737-d9d1-48ce-9832-dbb0b15bbbab] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:00:02.248320 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ac5c8ef0-acc1-4746-95ae-e862f56dc995 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:02.248810 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ac5c8ef0-acc1-4746-95ae-e862f56dc995 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:02.249406 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ac5c8ef0-acc1-4746-95ae-e862f56dc995 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:02.250385 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ac5c8ef0-acc1-4746-95ae-e862f56dc995 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:02.251053 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ac5c8ef0-acc1-4746-95ae-e862f56dc995 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:02.251716 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ac5c8ef0-acc1-4746-95ae-e862f56dc995 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:02.410346 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ac5c8ef0-acc1-4746-95ae-e862f56dc995 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568cea020ffb4b3fa74215dad3c17eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4c43138bd3461fb6d8fa9f924f7e99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:00:02.419610 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ac5c8ef0-acc1-4746-95ae-e862f56dc995 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] 10.222.0.26 "GET /compute/v2.1/servers/f58cf737-d9d1-48ce-9832-dbb0b15bbbab" status: 200 len: 1314 microversion: 2.1 time: 0.184620 Sep 13 00:00:02.420196 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 382/759] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:00:02 2022] GET /compute/v2.1/servers/f58cf737-d9d1-48ce-9832-dbb0b15bbbab => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:00:03.445046 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-60f20baf-d107-4902-816b-4115dda78afe tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:00:03.445650 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-60f20baf-d107-4902-816b-4115dda78afe tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] [instance: f58cf737-d9d1-48ce-9832-dbb0b15bbbab] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:00:03.452877 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-60f20baf-d107-4902-816b-4115dda78afe tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:03.453511 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-60f20baf-d107-4902-816b-4115dda78afe tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:03.454066 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-60f20baf-d107-4902-816b-4115dda78afe tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:03.454887 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-60f20baf-d107-4902-816b-4115dda78afe tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:03.455580 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-60f20baf-d107-4902-816b-4115dda78afe tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:03.456100 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-60f20baf-d107-4902-816b-4115dda78afe tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:03.609118 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-60f20baf-d107-4902-816b-4115dda78afe tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568cea020ffb4b3fa74215dad3c17eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4c43138bd3461fb6d8fa9f924f7e99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:00:03.623606 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-60f20baf-d107-4902-816b-4115dda78afe tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] 10.222.0.26 "GET /compute/v2.1/servers/f58cf737-d9d1-48ce-9832-dbb0b15bbbab" status: 200 len: 1314 microversion: 2.1 time: 0.182711 Sep 13 00:00:03.624662 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 378/760] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:00:03 2022] GET /compute/v2.1/servers/f58cf737-d9d1-48ce-9832-dbb0b15bbbab => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 00:00:04.652079 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9fc483a9-75bc-4bed-9f6e-32244f8db08f tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:00:04.652862 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9fc483a9-75bc-4bed-9f6e-32244f8db08f tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] [instance: f58cf737-d9d1-48ce-9832-dbb0b15bbbab] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:00:04.656604 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell0:SELECT=2 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:04.665964 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9fc483a9-75bc-4bed-9f6e-32244f8db08f tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:04.666905 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9fc483a9-75bc-4bed-9f6e-32244f8db08f tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:04.667616 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9fc483a9-75bc-4bed-9f6e-32244f8db08f tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:04.668476 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9fc483a9-75bc-4bed-9f6e-32244f8db08f tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:04.669325 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9fc483a9-75bc-4bed-9f6e-32244f8db08f tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:04.670103 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9fc483a9-75bc-4bed-9f6e-32244f8db08f tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:04.857680 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9fc483a9-75bc-4bed-9f6e-32244f8db08f tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568cea020ffb4b3fa74215dad3c17eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4c43138bd3461fb6d8fa9f924f7e99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:00:04.869553 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9fc483a9-75bc-4bed-9f6e-32244f8db08f tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] 10.222.0.26 "GET /compute/v2.1/servers/f58cf737-d9d1-48ce-9832-dbb0b15bbbab" status: 200 len: 1314 microversion: 2.1 time: 0.221998 Sep 13 00:00:04.871315 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 383/761] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:00:04 2022] GET /compute/v2.1/servers/f58cf737-d9d1-48ce-9832-dbb0b15bbbab => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 00:00:05.908811 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ecade8e9-7247-4230-8a72-75d97e405f2f tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:00:05.909499 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ecade8e9-7247-4230-8a72-75d97e405f2f tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] [instance: f58cf737-d9d1-48ce-9832-dbb0b15bbbab] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:00:05.912292 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell0:SELECT=2 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:05.913208 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell0:SELECT=6 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:05.923154 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ecade8e9-7247-4230-8a72-75d97e405f2f tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:05.923931 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ecade8e9-7247-4230-8a72-75d97e405f2f tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:05.924481 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ecade8e9-7247-4230-8a72-75d97e405f2f tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:05.925524 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ecade8e9-7247-4230-8a72-75d97e405f2f tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:05.926093 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ecade8e9-7247-4230-8a72-75d97e405f2f tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:05.926707 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ecade8e9-7247-4230-8a72-75d97e405f2f tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:06.258164 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ecade8e9-7247-4230-8a72-75d97e405f2f tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568cea020ffb4b3fa74215dad3c17eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4c43138bd3461fb6d8fa9f924f7e99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:00:06.267047 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ecade8e9-7247-4230-8a72-75d97e405f2f tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] 10.222.0.26 "GET /compute/v2.1/servers/f58cf737-d9d1-48ce-9832-dbb0b15bbbab" status: 200 len: 1314 microversion: 2.1 time: 0.362874 Sep 13 00:00:06.267729 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 379/762] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:00:05 2022] GET /compute/v2.1/servers/f58cf737-d9d1-48ce-9832-dbb0b15bbbab => generated 1314 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:00:07.305272 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f5df1a67-3b42-4d64-8c3f-cce2d0389e92 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:00:07.306377 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f5df1a67-3b42-4d64-8c3f-cce2d0389e92 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] [instance: f58cf737-d9d1-48ce-9832-dbb0b15bbbab] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:00:07.315416 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f5df1a67-3b42-4d64-8c3f-cce2d0389e92 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:07.316191 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f5df1a67-3b42-4d64-8c3f-cce2d0389e92 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:07.316769 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f5df1a67-3b42-4d64-8c3f-cce2d0389e92 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:07.317747 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f5df1a67-3b42-4d64-8c3f-cce2d0389e92 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:07.318334 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f5df1a67-3b42-4d64-8c3f-cce2d0389e92 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:07.318926 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f5df1a67-3b42-4d64-8c3f-cce2d0389e92 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:07.574061 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f5df1a67-3b42-4d64-8c3f-cce2d0389e92 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568cea020ffb4b3fa74215dad3c17eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4c43138bd3461fb6d8fa9f924f7e99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:00:07.584570 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f5df1a67-3b42-4d64-8c3f-cce2d0389e92 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] 10.222.0.26 "GET /compute/v2.1/servers/f58cf737-d9d1-48ce-9832-dbb0b15bbbab" status: 200 len: 1314 microversion: 2.1 time: 0.283859 Sep 13 00:00:07.585083 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 384/763] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:00:07 2022] GET /compute/v2.1/servers/f58cf737-d9d1-48ce-9832-dbb0b15bbbab => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:00:07.615567 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-42a2ad2f-170e-4d57-9ed9-1e69b9139374 req-6203d3cf-8068-447b-9795-6fc164c726f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f58cf737-d9d1-48ce-9832-dbb0b15bbbab", "name": "network-vif-plugged", "status": "completed", "tag": "8fae5321-fecc-48b6-a52f-4b9969027ab1"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 00:00:07.632569 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-42a2ad2f-170e-4d57-9ed9-1e69b9139374 req-6203d3cf-8068-447b-9795-6fc164c726f8 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:07.634612 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-42a2ad2f-170e-4d57-9ed9-1e69b9139374 req-6203d3cf-8068-447b-9795-6fc164c726f8 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:07.635629 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-42a2ad2f-170e-4d57-9ed9-1e69b9139374 req-6203d3cf-8068-447b-9795-6fc164c726f8 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:07.653338 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-42a2ad2f-170e-4d57-9ed9-1e69b9139374 req-6203d3cf-8068-447b-9795-6fc164c726f8 service nova] Creating event network-vif-plugged:8fae5321-fecc-48b6-a52f-4b9969027ab1 for instance f58cf737-d9d1-48ce-9832-dbb0b15bbbab on hv-cinder-82002 Sep 13 00:00:07.659315 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-42a2ad2f-170e-4d57-9ed9-1e69b9139374 req-6203d3cf-8068-447b-9795-6fc164c726f8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048437 Sep 13 00:00:07.660067 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 380/764] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 13 00:00:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 00:00:08.624352 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-30f4becb-e44d-4f52-8343-a346ce30d9f6 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:00:08.625973 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-30f4becb-e44d-4f52-8343-a346ce30d9f6 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] [instance: f58cf737-d9d1-48ce-9832-dbb0b15bbbab] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:00:08.638189 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-30f4becb-e44d-4f52-8343-a346ce30d9f6 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:08.638962 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-30f4becb-e44d-4f52-8343-a346ce30d9f6 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:08.639560 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-30f4becb-e44d-4f52-8343-a346ce30d9f6 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:08.640600 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-30f4becb-e44d-4f52-8343-a346ce30d9f6 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:08.641356 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-30f4becb-e44d-4f52-8343-a346ce30d9f6 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:08.642092 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-30f4becb-e44d-4f52-8343-a346ce30d9f6 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:08.836393 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-30f4becb-e44d-4f52-8343-a346ce30d9f6 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568cea020ffb4b3fa74215dad3c17eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4c43138bd3461fb6d8fa9f924f7e99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:00:08.845163 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-30f4becb-e44d-4f52-8343-a346ce30d9f6 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] 10.222.0.26 "GET /compute/v2.1/servers/f58cf737-d9d1-48ce-9832-dbb0b15bbbab" status: 200 len: 1314 microversion: 2.1 time: 0.226424 Sep 13 00:00:08.845927 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 385/765] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:00:08 2022] GET /compute/v2.1/servers/f58cf737-d9d1-48ce-9832-dbb0b15bbbab => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:00:09.871949 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d343ff32-e190-4f60-8217-cf07e8ba88b5 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:00:09.872847 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d343ff32-e190-4f60-8217-cf07e8ba88b5 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] [instance: f58cf737-d9d1-48ce-9832-dbb0b15bbbab] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:00:09.881503 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d343ff32-e190-4f60-8217-cf07e8ba88b5 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:09.882219 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d343ff32-e190-4f60-8217-cf07e8ba88b5 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:09.882761 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d343ff32-e190-4f60-8217-cf07e8ba88b5 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:09.883634 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d343ff32-e190-4f60-8217-cf07e8ba88b5 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:09.884138 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d343ff32-e190-4f60-8217-cf07e8ba88b5 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:09.884627 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d343ff32-e190-4f60-8217-cf07e8ba88b5 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:10.043917 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d343ff32-e190-4f60-8217-cf07e8ba88b5 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568cea020ffb4b3fa74215dad3c17eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4c43138bd3461fb6d8fa9f924f7e99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:00:10.052528 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d343ff32-e190-4f60-8217-cf07e8ba88b5 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] 10.222.0.26 "GET /compute/v2.1/servers/f58cf737-d9d1-48ce-9832-dbb0b15bbbab" status: 200 len: 1314 microversion: 2.1 time: 0.185840 Sep 13 00:00:10.053060 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 381/766] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:00:09 2022] GET /compute/v2.1/servers/f58cf737-d9d1-48ce-9832-dbb0b15bbbab => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:00:11.081025 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c71fb825-8012-47e6-85fb-f5f9e26f16df tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:00:11.082041 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c71fb825-8012-47e6-85fb-f5f9e26f16df tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] [instance: f58cf737-d9d1-48ce-9832-dbb0b15bbbab] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:00:11.086782 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:11.090901 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c71fb825-8012-47e6-85fb-f5f9e26f16df tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:11.091284 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c71fb825-8012-47e6-85fb-f5f9e26f16df tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:11.092014 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c71fb825-8012-47e6-85fb-f5f9e26f16df tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:11.092951 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c71fb825-8012-47e6-85fb-f5f9e26f16df tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:11.093510 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c71fb825-8012-47e6-85fb-f5f9e26f16df tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:11.094083 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c71fb825-8012-47e6-85fb-f5f9e26f16df tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:11.286000 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c71fb825-8012-47e6-85fb-f5f9e26f16df tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568cea020ffb4b3fa74215dad3c17eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4c43138bd3461fb6d8fa9f924f7e99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:00:11.300282 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c71fb825-8012-47e6-85fb-f5f9e26f16df tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] 10.222.0.26 "GET /compute/v2.1/servers/f58cf737-d9d1-48ce-9832-dbb0b15bbbab" status: 200 len: 1498 microversion: 2.1 time: 0.224222 Sep 13 00:00:11.301293 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 386/767] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:00:11 2022] GET /compute/v2.1/servers/f58cf737-d9d1-48ce-9832-dbb0b15bbbab => generated 1498 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:00:14.620211 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-dd91898e-67bd-491c-9983-0fe0eae968b4 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:00:14.620779 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-dd91898e-67bd-491c-9983-0fe0eae968b4 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] [instance: f58cf737-d9d1-48ce-9832-dbb0b15bbbab] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:00:14.627895 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dd91898e-67bd-491c-9983-0fe0eae968b4 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:14.628381 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dd91898e-67bd-491c-9983-0fe0eae968b4 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:14.628816 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dd91898e-67bd-491c-9983-0fe0eae968b4 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:14.629556 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dd91898e-67bd-491c-9983-0fe0eae968b4 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:14.630026 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dd91898e-67bd-491c-9983-0fe0eae968b4 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:14.630446 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dd91898e-67bd-491c-9983-0fe0eae968b4 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:14.657581 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-dd91898e-67bd-491c-9983-0fe0eae968b4 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] [instance: f58cf737-d9d1-48ce-9832-dbb0b15bbbab] Going to try to terminate instance {{(pid=126976) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 00:00:14.768374 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-dd91898e-67bd-491c-9983-0fe0eae968b4 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f58cf737-d9d1-48ce-9832-dbb0b15bbbab" status: 204 len: 0 microversion: 2.1 time: 0.150674 Sep 13 00:00:14.769020 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 382/768] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Sep 13 00:00:14 2022] DELETE /compute/v2.1/servers/f58cf737-d9d1-48ce-9832-dbb0b15bbbab => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 00:00:14.779087 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-dc5ab14a-97ef-4246-a6c0-a745b9977a7a tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:00:14.780184 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-dc5ab14a-97ef-4246-a6c0-a745b9977a7a tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] [instance: f58cf737-d9d1-48ce-9832-dbb0b15bbbab] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:00:14.792607 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dc5ab14a-97ef-4246-a6c0-a745b9977a7a tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:14.793112 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dc5ab14a-97ef-4246-a6c0-a745b9977a7a tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:14.793586 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dc5ab14a-97ef-4246-a6c0-a745b9977a7a tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:14.794341 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dc5ab14a-97ef-4246-a6c0-a745b9977a7a tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:14.794794 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dc5ab14a-97ef-4246-a6c0-a745b9977a7a tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:14.795268 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dc5ab14a-97ef-4246-a6c0-a745b9977a7a tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:14.798485 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=81 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:14.955370 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-dc5ab14a-97ef-4246-a6c0-a745b9977a7a tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568cea020ffb4b3fa74215dad3c17eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4c43138bd3461fb6d8fa9f924f7e99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:00:14.966008 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-dc5ab14a-97ef-4246-a6c0-a745b9977a7a tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] 10.222.0.26 "GET /compute/v2.1/servers/f58cf737-d9d1-48ce-9832-dbb0b15bbbab" status: 200 len: 1504 microversion: 2.1 time: 0.191879 Sep 13 00:00:14.967016 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 387/769] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:00:14 2022] GET /compute/v2.1/servers/f58cf737-d9d1-48ce-9832-dbb0b15bbbab => generated 1504 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:00:15.990404 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-64980d5a-5eb8-43c4-a6a1-766cb1c451f0 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:00:15.991135 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-64980d5a-5eb8-43c4-a6a1-766cb1c451f0 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] [instance: f58cf737-d9d1-48ce-9832-dbb0b15bbbab] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:00:15.998059 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-64980d5a-5eb8-43c4-a6a1-766cb1c451f0 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:15.998553 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-64980d5a-5eb8-43c4-a6a1-766cb1c451f0 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:15.998987 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-64980d5a-5eb8-43c4-a6a1-766cb1c451f0 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:15.999774 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-64980d5a-5eb8-43c4-a6a1-766cb1c451f0 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:16.000416 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-64980d5a-5eb8-43c4-a6a1-766cb1c451f0 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:16.000851 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-64980d5a-5eb8-43c4-a6a1-766cb1c451f0 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:16.140960 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-64980d5a-5eb8-43c4-a6a1-766cb1c451f0 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568cea020ffb4b3fa74215dad3c17eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4c43138bd3461fb6d8fa9f924f7e99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:00:16.153090 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-64980d5a-5eb8-43c4-a6a1-766cb1c451f0 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] 10.222.0.26 "GET /compute/v2.1/servers/f58cf737-d9d1-48ce-9832-dbb0b15bbbab" status: 200 len: 1504 microversion: 2.1 time: 0.166785 Sep 13 00:00:16.154029 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 383/770] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:00:15 2022] GET /compute/v2.1/servers/f58cf737-d9d1-48ce-9832-dbb0b15bbbab => generated 1504 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:00:16.937095 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-a0f28a13-c9a3-4a17-8741-ec59eefdfb5c req-439cf0f4-0cd5-4965-9669-b23a6b870d19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f58cf737-d9d1-48ce-9832-dbb0b15bbbab", "name": "network-vif-deleted", "tag": "8fae5321-fecc-48b6-a52f-4b9969027ab1"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 00:00:16.952579 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-a0f28a13-c9a3-4a17-8741-ec59eefdfb5c req-439cf0f4-0cd5-4965-9669-b23a6b870d19 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:16.953295 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-a0f28a13-c9a3-4a17-8741-ec59eefdfb5c req-439cf0f4-0cd5-4965-9669-b23a6b870d19 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:16.954055 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-a0f28a13-c9a3-4a17-8741-ec59eefdfb5c req-439cf0f4-0cd5-4965-9669-b23a6b870d19 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:16.974218 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-a0f28a13-c9a3-4a17-8741-ec59eefdfb5c req-439cf0f4-0cd5-4965-9669-b23a6b870d19 service nova] Creating event network-vif-deleted:8fae5321-fecc-48b6-a52f-4b9969027ab1 for instance f58cf737-d9d1-48ce-9832-dbb0b15bbbab on hv-cinder-82002 Sep 13 00:00:16.979873 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-a0f28a13-c9a3-4a17-8741-ec59eefdfb5c req-439cf0f4-0cd5-4965-9669-b23a6b870d19 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046655 Sep 13 00:00:16.984104 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 388/771] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 13 00:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 00:00:17.179184 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9f52a2be-9e97-46c3-bf3b-e6e2a3e2e772 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:00:17.179952 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9f52a2be-9e97-46c3-bf3b-e6e2a3e2e772 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] [instance: f58cf737-d9d1-48ce-9832-dbb0b15bbbab] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:00:17.187530 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9f52a2be-9e97-46c3-bf3b-e6e2a3e2e772 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:17.188118 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9f52a2be-9e97-46c3-bf3b-e6e2a3e2e772 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:17.188581 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9f52a2be-9e97-46c3-bf3b-e6e2a3e2e772 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:17.189484 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9f52a2be-9e97-46c3-bf3b-e6e2a3e2e772 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:17.190063 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9f52a2be-9e97-46c3-bf3b-e6e2a3e2e772 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:17.190528 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9f52a2be-9e97-46c3-bf3b-e6e2a3e2e772 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:17.228263 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9f52a2be-9e97-46c3-bf3b-e6e2a3e2e772 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:17.228817 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9f52a2be-9e97-46c3-bf3b-e6e2a3e2e772 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:17.229246 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9f52a2be-9e97-46c3-bf3b-e6e2a3e2e772 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:17.229794 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.objects.instance [None req-9f52a2be-9e97-46c3-bf3b-e6e2a3e2e772 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lazy-loading 'fault' on Instance uuid f58cf737-d9d1-48ce-9832-dbb0b15bbbab {{(pid=126976) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 00:00:17.286703 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-9f52a2be-9e97-46c3-bf3b-e6e2a3e2e772 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568cea020ffb4b3fa74215dad3c17eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4c43138bd3461fb6d8fa9f924f7e99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:00:17.295068 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9f52a2be-9e97-46c3-bf3b-e6e2a3e2e772 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] 10.222.0.26 "GET /compute/v2.1/servers/f58cf737-d9d1-48ce-9832-dbb0b15bbbab" status: 200 len: 1304 microversion: 2.1 time: 0.120462 Sep 13 00:00:17.295704 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 384/772] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:00:17 2022] GET /compute/v2.1/servers/f58cf737-d9d1-48ce-9832-dbb0b15bbbab => generated 1304 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:00:18.321373 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a8f5db49-128a-4fd0-94e9-e3c97621f953 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:00:18.322009 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a8f5db49-128a-4fd0-94e9-e3c97621f953 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] [instance: f58cf737-d9d1-48ce-9832-dbb0b15bbbab] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:00:18.329372 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a8f5db49-128a-4fd0-94e9-e3c97621f953 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:18.330031 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a8f5db49-128a-4fd0-94e9-e3c97621f953 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:18.330538 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a8f5db49-128a-4fd0-94e9-e3c97621f953 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:18.331321 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a8f5db49-128a-4fd0-94e9-e3c97621f953 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:18.331920 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a8f5db49-128a-4fd0-94e9-e3c97621f953 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:18.332345 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a8f5db49-128a-4fd0-94e9-e3c97621f953 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:18.370286 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a8f5db49-128a-4fd0-94e9-e3c97621f953 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:18.370777 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a8f5db49-128a-4fd0-94e9-e3c97621f953 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:18.371237 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a8f5db49-128a-4fd0-94e9-e3c97621f953 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:18.371708 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.objects.instance [None req-a8f5db49-128a-4fd0-94e9-e3c97621f953 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lazy-loading 'fault' on Instance uuid f58cf737-d9d1-48ce-9832-dbb0b15bbbab {{(pid=126975) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 00:00:18.420094 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a8f5db49-128a-4fd0-94e9-e3c97621f953 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568cea020ffb4b3fa74215dad3c17eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4c43138bd3461fb6d8fa9f924f7e99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:00:18.428983 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a8f5db49-128a-4fd0-94e9-e3c97621f953 tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] 10.222.0.26 "GET /compute/v2.1/servers/f58cf737-d9d1-48ce-9832-dbb0b15bbbab" status: 200 len: 1304 microversion: 2.1 time: 0.112529 Sep 13 00:00:18.429607 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 389/773] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:00:18 2022] GET /compute/v2.1/servers/f58cf737-d9d1-48ce-9832-dbb0b15bbbab => generated 1304 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:00:19.453349 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-315f2ffb-0cb0-475e-8ac6-9557e42dc2cf tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:00:19.454021 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-315f2ffb-0cb0-475e-8ac6-9557e42dc2cf tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] [instance: f58cf737-d9d1-48ce-9832-dbb0b15bbbab] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:00:19.460752 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-315f2ffb-0cb0-475e-8ac6-9557e42dc2cf tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:19.461244 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-315f2ffb-0cb0-475e-8ac6-9557e42dc2cf tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:19.461685 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-315f2ffb-0cb0-475e-8ac6-9557e42dc2cf tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:19.462375 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-315f2ffb-0cb0-475e-8ac6-9557e42dc2cf tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:19.462862 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-315f2ffb-0cb0-475e-8ac6-9557e42dc2cf tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:19.463281 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-315f2ffb-0cb0-475e-8ac6-9557e42dc2cf tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:19.499372 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-315f2ffb-0cb0-475e-8ac6-9557e42dc2cf tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:19.499867 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-315f2ffb-0cb0-475e-8ac6-9557e42dc2cf tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:19.500308 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-315f2ffb-0cb0-475e-8ac6-9557e42dc2cf tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:19.500734 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.objects.instance [None req-315f2ffb-0cb0-475e-8ac6-9557e42dc2cf tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lazy-loading 'fault' on Instance uuid f58cf737-d9d1-48ce-9832-dbb0b15bbbab {{(pid=126976) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 00:00:19.548932 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-315f2ffb-0cb0-475e-8ac6-9557e42dc2cf tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '568cea020ffb4b3fa74215dad3c17eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d4c43138bd3461fb6d8fa9f924f7e99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:00:19.557964 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-315f2ffb-0cb0-475e-8ac6-9557e42dc2cf tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] 10.222.0.26 "GET /compute/v2.1/servers/f58cf737-d9d1-48ce-9832-dbb0b15bbbab" status: 200 len: 1304 microversion: 2.1 time: 0.108844 Sep 13 00:00:19.558562 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 385/774] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:00:19 2022] GET /compute/v2.1/servers/f58cf737-d9d1-48ce-9832-dbb0b15bbbab => generated 1304 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:00:20.592302 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-25d04b56-b747-460f-b0fd-f56cb727258c tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:00:20.593137 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-25d04b56-b747-460f-b0fd-f56cb727258c tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] [instance: f58cf737-d9d1-48ce-9832-dbb0b15bbbab] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:00:20.600055 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-25d04b56-b747-460f-b0fd-f56cb727258c tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:20.600538 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-25d04b56-b747-460f-b0fd-f56cb727258c tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:20.600960 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-25d04b56-b747-460f-b0fd-f56cb727258c tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:20.601662 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-25d04b56-b747-460f-b0fd-f56cb727258c tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:20.602099 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-25d04b56-b747-460f-b0fd-f56cb727258c tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:20.602516 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-25d04b56-b747-460f-b0fd-f56cb727258c tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:20.617855 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-25d04b56-b747-460f-b0fd-f56cb727258c tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] HTTP exception thrown: Instance f58cf737-d9d1-48ce-9832-dbb0b15bbbab could not be found. Sep 13 00:00:20.619262 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-25d04b56-b747-460f-b0fd-f56cb727258c tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Request method failure captured: Sep 13 00:00:20.619262 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: request: GET /compute/v2.1/servers/f58cf737-d9d1-48ce-9832-dbb0b15bbbab HTTP/1.1 Sep 13 00:00:20.619262 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept: application/json Sep 13 00:00:20.619262 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Sep 13 00:00:20.619262 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Connection: close Sep 13 00:00:20.619262 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Length: 0 Sep 13 00:00:20.619262 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Type: application/json Sep 13 00:00:20.619262 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Host: 10.222.0.26 Sep 13 00:00:20.619262 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Sep 13 00:00:20.619262 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Sep 13 00:00:20.619262 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjH8fjZGPAdnUFlfOIcabYYu4a1f8nYEPg4zabH61Jwq2-IHcV01eyEiSJ5g8t8QNdx-Imlpt-KWdxOoncda0oFRLIOTBBdF5HYdXtMSu2gY8sp023XPINQEli32bHvC_ePukZfg14w1tlV8G9mEWsLYo8utWQ-1An7xD5b-9c98LJMic Sep 13 00:00:20.619262 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Sep 13 00:00:20.619262 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Sep 13 00:00:20.619262 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Sep 13 00:00:20.619262 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Sep 13 00:00:20.619262 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Sep 13 00:00:20.619262 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Sep 13 00:00:20.619262 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Id: 0d4c43138bd3461fb6d8fa9f924f7e99 Sep 13 00:00:20.619262 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-VolumesActionsTest-76163484 Sep 13 00:00:20.619262 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Role: member,reader Sep 13 00:00:20.619262 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Roles: member,reader Sep 13 00:00:20.621815 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0d4c43138bd3461fb6d8fa9f924f7e99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0d4c43138bd3461fb6d8fa9f924f7e99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0d4c43138bd3461fb6d8fa9f924f7e99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0d4c43138bd3461fb6d8fa9f924f7e99"}]}] Sep 13 00:00:20.621815 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-VolumesActionsTest-76163484 Sep 13 00:00:20.621815 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Id: 0d4c43138bd3461fb6d8fa9f924f7e99 Sep 13 00:00:20.621815 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-VolumesActionsTest-76163484 Sep 13 00:00:20.621815 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User: tempest-VolumesActionsTest-76163484-project Sep 13 00:00:20.621815 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Sep 13 00:00:20.621815 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Sep 13 00:00:20.621815 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Id: 568cea020ffb4b3fa74215dad3c17eba Sep 13 00:00:20.621815 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-VolumesActionsTest-76163484-project Sep 13 00:00:20.621815 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: method: > Sep 13 00:00:20.621815 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: exception: Instance f58cf737-d9d1-48ce-9832-dbb0b15bbbab could not be found. Sep 13 00:00:20.621815 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: action_args: {'id': 'f58cf737-d9d1-48ce-9832-dbb0b15bbbab'} Sep 13 00:00:20.623030 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 00:00:20.623030 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:00:20.623030 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 00:00:20.623030 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 00:00:20.623030 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 00:00:20.623030 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 00:00:20.623030 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 00:00:20.623030 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 00:00:20.623030 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 00:00:20.623030 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 00:00:20.623030 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f58cf737-d9d1-48ce-9832-dbb0b15bbbab could not be found. Sep 13 00:00:20.623030 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:00:20.623030 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 00:00:20.623030 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:00:20.623030 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:00:20.623030 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 00:00:20.623030 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 00:00:20.623030 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 00:00:20.623030 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 00:00:20.623030 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 00:00:20.624977 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 00:00:20.624977 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 00:00:20.624977 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 00:00:20.624977 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 00:00:20.624977 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 00:00:20.624977 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 00:00:20.624977 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 00:00:20.624977 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f58cf737-d9d1-48ce-9832-dbb0b15bbbab could not be found. Sep 13 00:00:20.624977 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:00:20.624977 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 00:00:20.624977 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:00:20.624977 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:00:20.624977 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 00:00:20.624977 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 00:00:20.624977 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 00:00:20.624977 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 00:00:20.624977 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f58cf737-d9d1-48ce-9832-dbb0b15bbbab could not be found. Sep 13 00:00:20.624977 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:00:20.626986 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-25d04b56-b747-460f-b0fd-f56cb727258c tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] Returning 404 to user: Instance f58cf737-d9d1-48ce-9832-dbb0b15bbbab could not be found. {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 00:00:20.626986 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-25d04b56-b747-460f-b0fd-f56cb727258c tempest-VolumesActionsTest-76163484 tempest-VolumesActionsTest-76163484-project] 10.222.0.26 "GET /compute/v2.1/servers/f58cf737-d9d1-48ce-9832-dbb0b15bbbab" status: 404 len: 111 microversion: 2.1 time: 0.032534 Sep 13 00:00:20.626986 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 390/775] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:00:20 2022] GET /compute/v2.1/servers/f58cf737-d9d1-48ce-9832-dbb0b15bbbab => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 00:00:22.683767 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e2905676-81a9-49cf-9a64-84c8a916e2e2 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:00:22.684366 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e2905676-81a9-49cf-9a64-84c8a916e2e2 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: f7a64139-3e2f-4855-a0d5-a667621b7ded] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:00:22.691963 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e2905676-81a9-49cf-9a64-84c8a916e2e2 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:22.692475 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e2905676-81a9-49cf-9a64-84c8a916e2e2 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:22.692911 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e2905676-81a9-49cf-9a64-84c8a916e2e2 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:22.693626 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e2905676-81a9-49cf-9a64-84c8a916e2e2 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:22.694080 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e2905676-81a9-49cf-9a64-84c8a916e2e2 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:22.694503 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e2905676-81a9-49cf-9a64-84c8a916e2e2 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:22.720264 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e2905676-81a9-49cf-9a64-84c8a916e2e2 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded/ips" status: 200 len: 146 microversion: 2.1 time: 0.242242 Sep 13 00:00:22.720833 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 386/776] 10.222.0.26 () {58 vars in 1248 bytes} [Tue Sep 13 00:00:22 2022] GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded/ips => generated 146 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 00:00:24.586860 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8de0e02c-0004-4552-9d2f-9ce60246ce8b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:00:24.589817 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8de0e02c-0004-4552-9d2f-9ce60246ce8b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:00:24.597942 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8de0e02c-0004-4552-9d2f-9ce60246ce8b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:24.598454 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8de0e02c-0004-4552-9d2f-9ce60246ce8b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:24.598876 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8de0e02c-0004-4552-9d2f-9ce60246ce8b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:24.599643 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8de0e02c-0004-4552-9d2f-9ce60246ce8b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:24.600086 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8de0e02c-0004-4552-9d2f-9ce60246ce8b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:24.600499 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8de0e02c-0004-4552-9d2f-9ce60246ce8b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:24.636312 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8de0e02c-0004-4552-9d2f-9ce60246ce8b tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.053673 Sep 13 00:00:24.636906 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 391/777] 10.222.0.26 () {60 vars in 1343 bytes} [Tue Sep 13 00:00:24 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:00:24.708671 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-db32d845-4c2f-4b15-a3c7-0549ca36bfc8 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:00:24.709298 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-db32d845-4c2f-4b15-a3c7-0549ca36bfc8 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:00:24.716993 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-db32d845-4c2f-4b15-a3c7-0549ca36bfc8 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:24.717507 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-db32d845-4c2f-4b15-a3c7-0549ca36bfc8 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:24.717947 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-db32d845-4c2f-4b15-a3c7-0549ca36bfc8 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:24.718666 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-db32d845-4c2f-4b15-a3c7-0549ca36bfc8 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:24.719122 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-db32d845-4c2f-4b15-a3c7-0549ca36bfc8 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:24.719571 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-db32d845-4c2f-4b15-a3c7-0549ca36bfc8 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:24.747633 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-db32d845-4c2f-4b15-a3c7-0549ca36bfc8 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Going to try to terminate instance {{(pid=126976) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 00:00:24.838722 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-db32d845-4c2f-4b15-a3c7-0549ca36bfc8 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 204 len: 0 microversion: 2.20 time: 0.133788 Sep 13 00:00:24.839765 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 387/778] 10.222.0.26 () {60 vars in 1280 bytes} [Tue Sep 13 00:00:24 2022] DELETE /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 00:00:24.855470 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-6ef00bdf-c3f7-4376-b1e6-20513ddb90bd tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:00:24.856523 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-6ef00bdf-c3f7-4376-b1e6-20513ddb90bd tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:00:24.864673 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6ef00bdf-c3f7-4376-b1e6-20513ddb90bd tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:24.865265 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6ef00bdf-c3f7-4376-b1e6-20513ddb90bd tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:24.865798 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6ef00bdf-c3f7-4376-b1e6-20513ddb90bd tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:24.866625 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6ef00bdf-c3f7-4376-b1e6-20513ddb90bd tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:24.867180 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6ef00bdf-c3f7-4376-b1e6-20513ddb90bd tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:24.867733 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6ef00bdf-c3f7-4376-b1e6-20513ddb90bd tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:25.010223 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-6ef00bdf-c3f7-4376-b1e6-20513ddb90bd tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:00:25.020344 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-6ef00bdf-c3f7-4376-b1e6-20513ddb90bd tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:00:25.021908 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-6ef00bdf-c3f7-4376-b1e6-20513ddb90bd tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:00:25.023119 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-6ef00bdf-c3f7-4376-b1e6-20513ddb90bd tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1723 microversion: 2.20 time: 0.175847 Sep 13 00:00:25.023803 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 392/779] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 13 00:00:24 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 00:00:25.166451 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-42272b12-09e9-46f5-811e-ba092bff0440 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "346a3f63-fb30-45a5-80a2-169db40bc5b9"}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 00:00:25.169066 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-42272b12-09e9-46f5-811e-ba092bff0440 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: f7a64139-3e2f-4855-a0d5-a667621b7ded] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:00:25.175469 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-42272b12-09e9-46f5-811e-ba092bff0440 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:25.175964 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-42272b12-09e9-46f5-811e-ba092bff0440 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:25.176403 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-42272b12-09e9-46f5-811e-ba092bff0440 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:25.177107 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-42272b12-09e9-46f5-811e-ba092bff0440 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:25.177560 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-42272b12-09e9-46f5-811e-ba092bff0440 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:25.177985 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-42272b12-09e9-46f5-811e-ba092bff0440 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:26.050824 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5002bfbd-b68e-4dbc-aeac-280ffdfa76af tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:00:26.052118 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5002bfbd-b68e-4dbc-aeac-280ffdfa76af tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:00:26.089703 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5002bfbd-b68e-4dbc-aeac-280ffdfa76af tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:26.090504 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5002bfbd-b68e-4dbc-aeac-280ffdfa76af tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:26.092233 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5002bfbd-b68e-4dbc-aeac-280ffdfa76af tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:26.093519 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5002bfbd-b68e-4dbc-aeac-280ffdfa76af tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:26.094401 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5002bfbd-b68e-4dbc-aeac-280ffdfa76af tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:26.095165 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5002bfbd-b68e-4dbc-aeac-280ffdfa76af tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:26.442261 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5002bfbd-b68e-4dbc-aeac-280ffdfa76af tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:00:26.459835 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5002bfbd-b68e-4dbc-aeac-280ffdfa76af tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:00:26.462810 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5002bfbd-b68e-4dbc-aeac-280ffdfa76af tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:00:26.464712 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5002bfbd-b68e-4dbc-aeac-280ffdfa76af tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1723 microversion: 2.20 time: 0.419732 Sep 13 00:00:26.465434 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-42272b12-09e9-46f5-811e-ba092bff0440 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "POST /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.302787 Sep 13 00:00:26.479316 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 388/780] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Sep 13 00:00:25 2022] POST /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded/os-volume_attachments => generated 194 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 00:00:26.479945 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 393/781] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 13 00:00:26 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1723 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 00:00:27.494532 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-fff5bc92-899b-40de-a714-0e3bd2c8dc67 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:00:27.496027 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-fff5bc92-899b-40de-a714-0e3bd2c8dc67 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:00:27.498347 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=2 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:27.509724 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fff5bc92-899b-40de-a714-0e3bd2c8dc67 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:27.510917 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fff5bc92-899b-40de-a714-0e3bd2c8dc67 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:27.511733 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fff5bc92-899b-40de-a714-0e3bd2c8dc67 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:27.512870 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fff5bc92-899b-40de-a714-0e3bd2c8dc67 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:27.513818 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fff5bc92-899b-40de-a714-0e3bd2c8dc67 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:27.514324 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fff5bc92-899b-40de-a714-0e3bd2c8dc67 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:27.557028 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:27.657920 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-fff5bc92-899b-40de-a714-0e3bd2c8dc67 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:00:27.676420 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-fff5bc92-899b-40de-a714-0e3bd2c8dc67 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:00:27.680068 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-fff5bc92-899b-40de-a714-0e3bd2c8dc67 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:00:27.682911 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-fff5bc92-899b-40de-a714-0e3bd2c8dc67 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1655 microversion: 2.20 time: 0.192965 Sep 13 00:00:27.684788 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 389/782] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 13 00:00:27 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1655 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 00:00:28.159547 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-5972adcf-5549-475b-b2be-caca53062b89 req-ef5c7ec6-0451-4458-ac31-c0febdffea19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3088bc31-f3ff-476d-a0ad-9f10186b442f", "name": "network-vif-deleted", "tag": "8a984b84-cffe-442a-8574-f76c08213db0"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 00:00:28.215897 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-5972adcf-5549-475b-b2be-caca53062b89 req-ef5c7ec6-0451-4458-ac31-c0febdffea19 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:28.216613 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-5972adcf-5549-475b-b2be-caca53062b89 req-ef5c7ec6-0451-4458-ac31-c0febdffea19 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:28.217361 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-5972adcf-5549-475b-b2be-caca53062b89 req-ef5c7ec6-0451-4458-ac31-c0febdffea19 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:28.270053 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-5972adcf-5549-475b-b2be-caca53062b89 req-ef5c7ec6-0451-4458-ac31-c0febdffea19 service nova] Creating event network-vif-deleted:8a984b84-cffe-442a-8574-f76c08213db0 for instance 3088bc31-f3ff-476d-a0ad-9f10186b442f on hv-cinder-82002 Sep 13 00:00:28.299249 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-5972adcf-5549-475b-b2be-caca53062b89 req-ef5c7ec6-0451-4458-ac31-c0febdffea19 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156412 Sep 13 00:00:28.302942 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 394/783] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 13 00:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 00:00:28.714925 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c9a78060-ad3c-4f91-8519-9a9ebd5d4a4c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:00:28.715755 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c9a78060-ad3c-4f91-8519-9a9ebd5d4a4c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:00:28.725468 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c9a78060-ad3c-4f91-8519-9a9ebd5d4a4c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:28.727892 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c9a78060-ad3c-4f91-8519-9a9ebd5d4a4c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:28.728625 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c9a78060-ad3c-4f91-8519-9a9ebd5d4a4c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:28.735088 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c9a78060-ad3c-4f91-8519-9a9ebd5d4a4c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:28.735794 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c9a78060-ad3c-4f91-8519-9a9ebd5d4a4c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:28.736375 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c9a78060-ad3c-4f91-8519-9a9ebd5d4a4c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:28.795128 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c9a78060-ad3c-4f91-8519-9a9ebd5d4a4c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:28.795791 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c9a78060-ad3c-4f91-8519-9a9ebd5d4a4c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:28.796407 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c9a78060-ad3c-4f91-8519-9a9ebd5d4a4c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:28.797213 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.objects.instance [None req-c9a78060-ad3c-4f91-8519-9a9ebd5d4a4c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lazy-loading 'fault' on Instance uuid 3088bc31-f3ff-476d-a0ad-9f10186b442f {{(pid=126976) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 00:00:28.859815 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c9a78060-ad3c-4f91-8519-9a9ebd5d4a4c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:00:28.874763 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c9a78060-ad3c-4f91-8519-9a9ebd5d4a4c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:00:28.877998 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c9a78060-ad3c-4f91-8519-9a9ebd5d4a4c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '296f02c73fc548969bf60df4f8f372b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b2f385a651c408bb9d32b5c4e1ab6ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:00:28.879887 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c9a78060-ad3c-4f91-8519-9a9ebd5d4a4c tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 200 len: 1371 microversion: 2.20 time: 0.170256 Sep 13 00:00:28.880937 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 390/784] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 13 00:00:28 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 00:00:29.949720 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c2c67226-c193-4483-99e1-56844989ae5a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:00:29.952211 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c2c67226-c193-4483-99e1-56844989ae5a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:00:29.986118 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c2c67226-c193-4483-99e1-56844989ae5a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:29.989923 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c2c67226-c193-4483-99e1-56844989ae5a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:29.992314 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c2c67226-c193-4483-99e1-56844989ae5a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:29.995004 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c2c67226-c193-4483-99e1-56844989ae5a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:29.996831 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c2c67226-c193-4483-99e1-56844989ae5a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:29.998930 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c2c67226-c193-4483-99e1-56844989ae5a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:30.022252 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-c2c67226-c193-4483-99e1-56844989ae5a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] HTTP exception thrown: Instance 3088bc31-f3ff-476d-a0ad-9f10186b442f could not be found. Sep 13 00:00:30.036654 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c2c67226-c193-4483-99e1-56844989ae5a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Request method failure captured: Sep 13 00:00:30.036654 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: request: GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f HTTP/1.1 Sep 13 00:00:30.036654 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept: application/json Sep 13 00:00:30.036654 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Sep 13 00:00:30.036654 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Connection: close Sep 13 00:00:30.036654 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Length: 0 Sep 13 00:00:30.036654 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Type: application/json Sep 13 00:00:30.036654 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Host: 10.222.0.26 Sep 13 00:00:30.036654 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Sep 13 00:00:30.036654 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Sep 13 00:00:30.036654 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjH8ZzAZBJpVEa5OR-IWoXlXYL0GuBqrJSVm_QRjmnskUPrxkjni-j-imzFjCx61W-2-_IDrOSxj7B1Hx4rUd1feLPlScBV0O7d5sdYxQlKDGnDX7yzSfaJN20gjNVn3GVaRtOyngD8LHmRpGHp7346Gx8ARU2ju8xnZq9P_ENjF7DvL0 Sep 13 00:00:30.036654 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Sep 13 00:00:30.036654 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Sep 13 00:00:30.036654 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Sep 13 00:00:30.036654 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Sep 13 00:00:30.036654 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 00:00:30.036654 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Sep 13 00:00:30.036654 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Sep 13 00:00:30.036654 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Id: 6b2f385a651c408bb9d32b5c4e1ab6ff Sep 13 00:00:30.036654 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-895466941 Sep 13 00:00:30.036654 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Role: member,reader Sep 13 00:00:30.036654 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Roles: member,reader Sep 13 00:00:30.038216 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6b2f385a651c408bb9d32b5c4e1ab6ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6b2f385a651c408bb9d32b5c4e1ab6ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6b2f385a651c408bb9d32b5c4e1ab6ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6b2f385a651c408bb9d32b5c4e1ab6ff"}]}] Sep 13 00:00:30.038216 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-AttachVolumeShelveTestJSON-895466941 Sep 13 00:00:30.038216 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Id: 6b2f385a651c408bb9d32b5c4e1ab6ff Sep 13 00:00:30.038216 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-895466941 Sep 13 00:00:30.038216 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User: tempest-AttachVolumeShelveTestJSON-895466941-project Sep 13 00:00:30.038216 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Sep 13 00:00:30.038216 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Sep 13 00:00:30.038216 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Id: 296f02c73fc548969bf60df4f8f372b0 Sep 13 00:00:30.038216 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-AttachVolumeShelveTestJSON-895466941-project Sep 13 00:00:30.038216 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: method: > Sep 13 00:00:30.038216 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: exception: Instance 3088bc31-f3ff-476d-a0ad-9f10186b442f could not be found. Sep 13 00:00:30.038216 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: action_args: {'id': '3088bc31-f3ff-476d-a0ad-9f10186b442f'} Sep 13 00:00:30.038996 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 00:00:30.038996 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:00:30.038996 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 00:00:30.038996 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 00:00:30.038996 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 00:00:30.038996 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 00:00:30.038996 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 00:00:30.038996 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 00:00:30.038996 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 00:00:30.038996 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 00:00:30.038996 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3088bc31-f3ff-476d-a0ad-9f10186b442f could not be found. Sep 13 00:00:30.038996 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:00:30.038996 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 00:00:30.038996 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:00:30.038996 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:00:30.038996 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 00:00:30.038996 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 00:00:30.038996 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 00:00:30.038996 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 00:00:30.038996 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 00:00:30.040295 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 00:00:30.040295 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 00:00:30.040295 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 00:00:30.040295 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 00:00:30.040295 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 00:00:30.040295 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 00:00:30.040295 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 00:00:30.040295 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3088bc31-f3ff-476d-a0ad-9f10186b442f could not be found. Sep 13 00:00:30.040295 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:00:30.040295 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 00:00:30.040295 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:00:30.040295 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:00:30.040295 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 00:00:30.040295 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 00:00:30.040295 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 00:00:30.040295 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 00:00:30.040295 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3088bc31-f3ff-476d-a0ad-9f10186b442f could not be found. Sep 13 00:00:30.040295 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:00:30.041518 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c2c67226-c193-4483-99e1-56844989ae5a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Returning 404 to user: Instance 3088bc31-f3ff-476d-a0ad-9f10186b442f could not be found. {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 00:00:30.048248 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c2c67226-c193-4483-99e1-56844989ae5a tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 404 len: 111 microversion: 2.20 time: 0.107102 Sep 13 00:00:30.049004 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 395/785] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 13 00:00:29 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 00:00:30.071327 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-95f3dec9-cd51-46ea-a90c-241e1c636e27 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '.version_select at 0x7fed01299550>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:00:30.125170 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-95f3dec9-cd51-46ea-a90c-241e1c636e27 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-487791268" status: 204 len: 0 microversion: 2.20 time: 0.066799 Sep 13 00:00:30.126722 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 391/786] 10.222.0.26 () {60 vars in 1259 bytes} [Tue Sep 13 00:00:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-487791268 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 00:00:32.428151 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f2f6a7f3-3fd9-4917-997d-2d76e10caab4 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:00:32.428966 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f2f6a7f3-3fd9-4917-997d-2d76e10caab4 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:00:32.445215 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f2f6a7f3-3fd9-4917-997d-2d76e10caab4 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:32.445724 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f2f6a7f3-3fd9-4917-997d-2d76e10caab4 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:32.446181 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f2f6a7f3-3fd9-4917-997d-2d76e10caab4 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:32.447107 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f2f6a7f3-3fd9-4917-997d-2d76e10caab4 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:32.447612 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f2f6a7f3-3fd9-4917-997d-2d76e10caab4 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:32.448063 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f2f6a7f3-3fd9-4917-997d-2d76e10caab4 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:32.476076 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-f2f6a7f3-3fd9-4917-997d-2d76e10caab4 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] HTTP exception thrown: Instance 3088bc31-f3ff-476d-a0ad-9f10186b442f could not be found. Sep 13 00:00:32.478010 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f2f6a7f3-3fd9-4917-997d-2d76e10caab4 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Request method failure captured: Sep 13 00:00:32.478010 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: request: DELETE /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f HTTP/1.1 Sep 13 00:00:32.478010 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept: application/json Sep 13 00:00:32.478010 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Sep 13 00:00:32.478010 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Connection: close Sep 13 00:00:32.478010 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Length: 0 Sep 13 00:00:32.478010 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Type: application/json Sep 13 00:00:32.478010 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Host: 10.222.0.26 Sep 13 00:00:32.478010 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Sep 13 00:00:32.478010 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Sep 13 00:00:32.478010 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjH8ZzAZBJpVEa5OR-IWoXlXYL0GuBqrJSVm_QRjmnskUPrxkjni-j-imzFjCx61W-2-_IDrOSxj7B1Hx4rUd1feLPlScBV0O7d5sdYxQlKDGnDX7yzSfaJN20gjNVn3GVaRtOyngD8LHmRpGHp7346Gx8ARU2ju8xnZq9P_ENjF7DvL0 Sep 13 00:00:32.478010 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Sep 13 00:00:32.478010 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Sep 13 00:00:32.478010 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Sep 13 00:00:32.478010 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Sep 13 00:00:32.478010 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 00:00:32.478010 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Sep 13 00:00:32.478010 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Sep 13 00:00:32.478010 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Id: 6b2f385a651c408bb9d32b5c4e1ab6ff Sep 13 00:00:32.478010 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-895466941 Sep 13 00:00:32.478010 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Role: member,reader Sep 13 00:00:32.478010 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Roles: member,reader Sep 13 00:00:32.480841 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6b2f385a651c408bb9d32b5c4e1ab6ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6b2f385a651c408bb9d32b5c4e1ab6ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6b2f385a651c408bb9d32b5c4e1ab6ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6b2f385a651c408bb9d32b5c4e1ab6ff"}]}] Sep 13 00:00:32.480841 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-AttachVolumeShelveTestJSON-895466941 Sep 13 00:00:32.480841 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Id: 6b2f385a651c408bb9d32b5c4e1ab6ff Sep 13 00:00:32.480841 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-895466941 Sep 13 00:00:32.480841 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User: tempest-AttachVolumeShelveTestJSON-895466941-project Sep 13 00:00:32.480841 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Sep 13 00:00:32.480841 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Sep 13 00:00:32.480841 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Id: 296f02c73fc548969bf60df4f8f372b0 Sep 13 00:00:32.480841 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-AttachVolumeShelveTestJSON-895466941-project Sep 13 00:00:32.480841 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: method: > Sep 13 00:00:32.480841 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: exception: Instance 3088bc31-f3ff-476d-a0ad-9f10186b442f could not be found. Sep 13 00:00:32.480841 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: action_args: {'id': '3088bc31-f3ff-476d-a0ad-9f10186b442f'} Sep 13 00:00:32.483496 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 00:00:32.483496 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:00:32.483496 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 00:00:32.483496 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 00:00:32.483496 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 00:00:32.483496 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 00:00:32.483496 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 00:00:32.483496 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 00:00:32.483496 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 00:00:32.483496 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 00:00:32.483496 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3088bc31-f3ff-476d-a0ad-9f10186b442f could not be found. Sep 13 00:00:32.483496 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:00:32.483496 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 00:00:32.483496 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:00:32.483496 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:00:32.483496 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 00:00:32.483496 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 00:00:32.483496 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 00:00:32.483496 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 00:00:32.483496 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 00:00:32.493258 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 00:00:32.493258 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 00:00:32.493258 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 00:00:32.493258 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 00:00:32.493258 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 00:00:32.493258 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 00:00:32.493258 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 00:00:32.493258 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 00:00:32.493258 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 00:00:32.493258 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3088bc31-f3ff-476d-a0ad-9f10186b442f could not be found. Sep 13 00:00:32.493258 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:00:32.493258 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 00:00:32.493258 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:00:32.493258 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:00:32.493258 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 00:00:32.493258 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 00:00:32.493258 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 00:00:32.493258 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 00:00:32.493258 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3088bc31-f3ff-476d-a0ad-9f10186b442f could not be found. Sep 13 00:00:32.493258 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:00:32.498699 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f2f6a7f3-3fd9-4917-997d-2d76e10caab4 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Returning 404 to user: Instance 3088bc31-f3ff-476d-a0ad-9f10186b442f could not be found. {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 00:00:32.498699 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f2f6a7f3-3fd9-4917-997d-2d76e10caab4 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 404 len: 111 microversion: 2.20 time: 0.055933 Sep 13 00:00:32.498699 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 396/787] 10.222.0.26 () {60 vars in 1280 bytes} [Tue Sep 13 00:00:32 2022] DELETE /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 00:00:32.504818 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2ad230f6-305f-451f-9d5b-84bd71068de9 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:00:32.506354 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2ad230f6-305f-451f-9d5b-84bd71068de9 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 3088bc31-f3ff-476d-a0ad-9f10186b442f] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:00:32.528511 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2ad230f6-305f-451f-9d5b-84bd71068de9 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:32.529106 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2ad230f6-305f-451f-9d5b-84bd71068de9 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:32.529564 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2ad230f6-305f-451f-9d5b-84bd71068de9 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:32.531292 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2ad230f6-305f-451f-9d5b-84bd71068de9 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:32.531766 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2ad230f6-305f-451f-9d5b-84bd71068de9 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:32.532243 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2ad230f6-305f-451f-9d5b-84bd71068de9 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:32.565339 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-2ad230f6-305f-451f-9d5b-84bd71068de9 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] HTTP exception thrown: Instance 3088bc31-f3ff-476d-a0ad-9f10186b442f could not be found. Sep 13 00:00:32.568907 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2ad230f6-305f-451f-9d5b-84bd71068de9 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Request method failure captured: Sep 13 00:00:32.568907 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: request: GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f HTTP/1.1 Sep 13 00:00:32.568907 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Accept: application/json Sep 13 00:00:32.568907 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Sep 13 00:00:32.568907 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Connection: close Sep 13 00:00:32.568907 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Content-Length: 0 Sep 13 00:00:32.568907 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Content-Type: application/json Sep 13 00:00:32.568907 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Host: 10.222.0.26 Sep 13 00:00:32.568907 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Sep 13 00:00:32.568907 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Sep 13 00:00:32.568907 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjH8ZzAZBJpVEa5OR-IWoXlXYL0GuBqrJSVm_QRjmnskUPrxkjni-j-imzFjCx61W-2-_IDrOSxj7B1Hx4rUd1feLPlScBV0O7d5sdYxQlKDGnDX7yzSfaJN20gjNVn3GVaRtOyngD8LHmRpGHp7346Gx8ARU2ju8xnZq9P_ENjF7DvL0 Sep 13 00:00:32.568907 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Sep 13 00:00:32.568907 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Sep 13 00:00:32.568907 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Sep 13 00:00:32.568907 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Sep 13 00:00:32.568907 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 00:00:32.568907 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Sep 13 00:00:32.568907 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Sep 13 00:00:32.568907 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Id: 6b2f385a651c408bb9d32b5c4e1ab6ff Sep 13 00:00:32.568907 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-895466941 Sep 13 00:00:32.568907 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Role: member,reader Sep 13 00:00:32.568907 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Roles: member,reader Sep 13 00:00:32.570429 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6b2f385a651c408bb9d32b5c4e1ab6ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6b2f385a651c408bb9d32b5c4e1ab6ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6b2f385a651c408bb9d32b5c4e1ab6ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6b2f385a651c408bb9d32b5c4e1ab6ff"}]}] Sep 13 00:00:32.570429 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-AttachVolumeShelveTestJSON-895466941 Sep 13 00:00:32.570429 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant-Id: 6b2f385a651c408bb9d32b5c4e1ab6ff Sep 13 00:00:32.570429 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-895466941 Sep 13 00:00:32.570429 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User: tempest-AttachVolumeShelveTestJSON-895466941-project Sep 13 00:00:32.570429 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Sep 13 00:00:32.570429 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Sep 13 00:00:32.570429 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Id: 296f02c73fc548969bf60df4f8f372b0 Sep 13 00:00:32.570429 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-AttachVolumeShelveTestJSON-895466941-project Sep 13 00:00:32.570429 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: method: > Sep 13 00:00:32.570429 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: exception: Instance 3088bc31-f3ff-476d-a0ad-9f10186b442f could not be found. Sep 13 00:00:32.570429 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: action_args: {'id': '3088bc31-f3ff-476d-a0ad-9f10186b442f'} Sep 13 00:00:32.571182 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 00:00:32.571182 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:00:32.571182 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 00:00:32.571182 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 00:00:32.571182 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 00:00:32.571182 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 00:00:32.571182 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 00:00:32.571182 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 00:00:32.571182 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 00:00:32.571182 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 00:00:32.571182 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3088bc31-f3ff-476d-a0ad-9f10186b442f could not be found. Sep 13 00:00:32.571182 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:00:32.571182 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 00:00:32.571182 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:00:32.571182 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:00:32.571182 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 00:00:32.571182 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 00:00:32.571182 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 00:00:32.571182 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 00:00:32.571182 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 00:00:32.576712 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 00:00:32.576712 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 00:00:32.576712 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 00:00:32.576712 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 00:00:32.576712 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 00:00:32.576712 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 00:00:32.576712 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 00:00:32.576712 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3088bc31-f3ff-476d-a0ad-9f10186b442f could not be found. Sep 13 00:00:32.576712 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:00:32.576712 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 00:00:32.576712 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:00:32.576712 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:00:32.576712 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 00:00:32.576712 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 00:00:32.576712 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 00:00:32.576712 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 00:00:32.576712 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3088bc31-f3ff-476d-a0ad-9f10186b442f could not be found. Sep 13 00:00:32.576712 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:00:32.579979 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2ad230f6-305f-451f-9d5b-84bd71068de9 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Returning 404 to user: Instance 3088bc31-f3ff-476d-a0ad-9f10186b442f could not be found. {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 00:00:32.579979 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2ad230f6-305f-451f-9d5b-84bd71068de9 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f" status: 404 len: 111 microversion: 2.20 time: 0.079873 Sep 13 00:00:32.579979 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 392/788] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 13 00:00:32 2022] GET /compute/v2.1/servers/3088bc31-f3ff-476d-a0ad-9f10186b442f => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 00:00:33.880483 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-dd9374c2-e552-49ed-b5ae-c9ae371c37bb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:00:33.881081 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-dd9374c2-e552-49ed-b5ae-c9ae371c37bb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:00:33.895908 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dd9374c2-e552-49ed-b5ae-c9ae371c37bb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:33.896646 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dd9374c2-e552-49ed-b5ae-c9ae371c37bb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:33.897448 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dd9374c2-e552-49ed-b5ae-c9ae371c37bb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:33.900526 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dd9374c2-e552-49ed-b5ae-c9ae371c37bb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:33.901148 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dd9374c2-e552-49ed-b5ae-c9ae371c37bb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:33.901712 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-dd9374c2-e552-49ed-b5ae-c9ae371c37bb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:33.951410 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-dd9374c2-e552-49ed-b5ae-c9ae371c37bb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] HTTP exception thrown: Instance 893ed869-802c-4a92-b7ab-d2aa8324fb65 could not be found. Sep 13 00:00:33.953095 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-dd9374c2-e552-49ed-b5ae-c9ae371c37bb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Request method failure captured: Sep 13 00:00:33.953095 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: request: DELETE /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 HTTP/1.1 Sep 13 00:00:33.953095 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept: application/json Sep 13 00:00:33.953095 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Sep 13 00:00:33.953095 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Connection: close Sep 13 00:00:33.953095 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Length: 0 Sep 13 00:00:33.953095 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Type: application/json Sep 13 00:00:33.953095 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Host: 10.222.0.26 Sep 13 00:00:33.953095 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Sep 13 00:00:33.953095 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Sep 13 00:00:33.953095 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjH8ZzAZBJpVEa5OR-IWoXlXYL0GuBqrJSVm_QRjmnskUPrxkjni-j-imzFjCx61W-2-_IDrOSxj7B1Hx4rUd1feLPlScBV0O7d5sdYxQlKDGnDX7yzSfaJN20gjNVn3GVaRtOyngD8LHmRpGHp7346Gx8ARU2ju8xnZq9P_ENjF7DvL0 Sep 13 00:00:33.953095 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Sep 13 00:00:33.953095 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Sep 13 00:00:33.953095 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Sep 13 00:00:33.953095 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Sep 13 00:00:33.953095 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 00:00:33.953095 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Sep 13 00:00:33.953095 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Sep 13 00:00:33.953095 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Id: 6b2f385a651c408bb9d32b5c4e1ab6ff Sep 13 00:00:33.953095 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-895466941 Sep 13 00:00:33.953095 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Role: member,reader Sep 13 00:00:33.953095 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Roles: member,reader Sep 13 00:00:33.955372 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6b2f385a651c408bb9d32b5c4e1ab6ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6b2f385a651c408bb9d32b5c4e1ab6ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6b2f385a651c408bb9d32b5c4e1ab6ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6b2f385a651c408bb9d32b5c4e1ab6ff"}]}] Sep 13 00:00:33.955372 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-AttachVolumeShelveTestJSON-895466941 Sep 13 00:00:33.955372 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Id: 6b2f385a651c408bb9d32b5c4e1ab6ff Sep 13 00:00:33.955372 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-895466941 Sep 13 00:00:33.955372 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User: tempest-AttachVolumeShelveTestJSON-895466941-project Sep 13 00:00:33.955372 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Sep 13 00:00:33.955372 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Sep 13 00:00:33.955372 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Id: 296f02c73fc548969bf60df4f8f372b0 Sep 13 00:00:33.955372 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-AttachVolumeShelveTestJSON-895466941-project Sep 13 00:00:33.955372 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: method: > Sep 13 00:00:33.955372 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: exception: Instance 893ed869-802c-4a92-b7ab-d2aa8324fb65 could not be found. Sep 13 00:00:33.955372 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: action_args: {'id': '893ed869-802c-4a92-b7ab-d2aa8324fb65'} Sep 13 00:00:33.958018 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 00:00:33.958018 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:00:33.958018 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 00:00:33.958018 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 00:00:33.958018 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 00:00:33.958018 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 00:00:33.958018 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 00:00:33.958018 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 00:00:33.958018 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 00:00:33.958018 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 00:00:33.958018 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 893ed869-802c-4a92-b7ab-d2aa8324fb65 could not be found. Sep 13 00:00:33.958018 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:00:33.958018 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 00:00:33.958018 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:00:33.958018 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:00:33.958018 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 00:00:33.958018 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 00:00:33.958018 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 00:00:33.958018 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 00:00:33.958018 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 00:00:33.965142 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 00:00:33.965142 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 00:00:33.965142 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 00:00:33.965142 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 00:00:33.965142 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 00:00:33.965142 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 00:00:33.965142 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 00:00:33.965142 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 00:00:33.965142 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 00:00:33.965142 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 893ed869-802c-4a92-b7ab-d2aa8324fb65 could not be found. Sep 13 00:00:33.965142 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:00:33.965142 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 00:00:33.965142 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:00:33.965142 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:00:33.965142 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 00:00:33.965142 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 00:00:33.965142 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 00:00:33.965142 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 00:00:33.965142 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 893ed869-802c-4a92-b7ab-d2aa8324fb65 could not be found. Sep 13 00:00:33.965142 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:00:33.968521 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-dd9374c2-e552-49ed-b5ae-c9ae371c37bb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Returning 404 to user: Instance 893ed869-802c-4a92-b7ab-d2aa8324fb65 could not be found. {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 00:00:33.968521 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-dd9374c2-e552-49ed-b5ae-c9ae371c37bb tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "DELETE /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 404 len: 111 microversion: 2.20 time: 0.081406 Sep 13 00:00:33.968521 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 397/789] 10.222.0.26 () {60 vars in 1280 bytes} [Tue Sep 13 00:00:33 2022] DELETE /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 00:00:33.999171 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-edd4d8f9-213c-4fe1-b6ae-6fb2989627b8 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:00:34.004339 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-edd4d8f9-213c-4fe1-b6ae-6fb2989627b8 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] [instance: 893ed869-802c-4a92-b7ab-d2aa8324fb65] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:00:34.030777 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-edd4d8f9-213c-4fe1-b6ae-6fb2989627b8 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:34.033757 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-edd4d8f9-213c-4fe1-b6ae-6fb2989627b8 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:34.036292 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-edd4d8f9-213c-4fe1-b6ae-6fb2989627b8 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:34.040201 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-edd4d8f9-213c-4fe1-b6ae-6fb2989627b8 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:34.044555 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-edd4d8f9-213c-4fe1-b6ae-6fb2989627b8 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:34.047310 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-edd4d8f9-213c-4fe1-b6ae-6fb2989627b8 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:34.086791 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-edd4d8f9-213c-4fe1-b6ae-6fb2989627b8 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] HTTP exception thrown: Instance 893ed869-802c-4a92-b7ab-d2aa8324fb65 could not be found. Sep 13 00:00:34.088668 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-edd4d8f9-213c-4fe1-b6ae-6fb2989627b8 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Request method failure captured: Sep 13 00:00:34.088668 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: request: GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 HTTP/1.1 Sep 13 00:00:34.088668 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Accept: application/json Sep 13 00:00:34.088668 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Sep 13 00:00:34.088668 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Connection: close Sep 13 00:00:34.088668 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Content-Length: 0 Sep 13 00:00:34.088668 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Content-Type: application/json Sep 13 00:00:34.088668 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Host: 10.222.0.26 Sep 13 00:00:34.088668 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Sep 13 00:00:34.088668 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Sep 13 00:00:34.088668 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjH8ZzAZBJpVEa5OR-IWoXlXYL0GuBqrJSVm_QRjmnskUPrxkjni-j-imzFjCx61W-2-_IDrOSxj7B1Hx4rUd1feLPlScBV0O7d5sdYxQlKDGnDX7yzSfaJN20gjNVn3GVaRtOyngD8LHmRpGHp7346Gx8ARU2ju8xnZq9P_ENjF7DvL0 Sep 13 00:00:34.088668 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Sep 13 00:00:34.088668 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Sep 13 00:00:34.088668 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Sep 13 00:00:34.088668 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Sep 13 00:00:34.088668 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 00:00:34.088668 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Sep 13 00:00:34.088668 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Sep 13 00:00:34.088668 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Id: 6b2f385a651c408bb9d32b5c4e1ab6ff Sep 13 00:00:34.088668 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-895466941 Sep 13 00:00:34.088668 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Role: member,reader Sep 13 00:00:34.088668 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Roles: member,reader Sep 13 00:00:34.090290 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6b2f385a651c408bb9d32b5c4e1ab6ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6b2f385a651c408bb9d32b5c4e1ab6ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6b2f385a651c408bb9d32b5c4e1ab6ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6b2f385a651c408bb9d32b5c4e1ab6ff"}]}] Sep 13 00:00:34.090290 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-AttachVolumeShelveTestJSON-895466941 Sep 13 00:00:34.090290 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant-Id: 6b2f385a651c408bb9d32b5c4e1ab6ff Sep 13 00:00:34.090290 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-895466941 Sep 13 00:00:34.090290 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User: tempest-AttachVolumeShelveTestJSON-895466941-project Sep 13 00:00:34.090290 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Sep 13 00:00:34.090290 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Sep 13 00:00:34.090290 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Id: 296f02c73fc548969bf60df4f8f372b0 Sep 13 00:00:34.090290 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-AttachVolumeShelveTestJSON-895466941-project Sep 13 00:00:34.090290 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: method: > Sep 13 00:00:34.090290 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: exception: Instance 893ed869-802c-4a92-b7ab-d2aa8324fb65 could not be found. Sep 13 00:00:34.090290 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: action_args: {'id': '893ed869-802c-4a92-b7ab-d2aa8324fb65'} Sep 13 00:00:34.091157 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 00:00:34.091157 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:00:34.091157 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 00:00:34.091157 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 00:00:34.091157 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 00:00:34.091157 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 00:00:34.091157 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 00:00:34.091157 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 00:00:34.091157 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 00:00:34.091157 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 00:00:34.091157 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 893ed869-802c-4a92-b7ab-d2aa8324fb65 could not be found. Sep 13 00:00:34.091157 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:00:34.091157 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 00:00:34.091157 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:00:34.091157 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:00:34.091157 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 00:00:34.091157 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 00:00:34.091157 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 00:00:34.091157 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 00:00:34.091157 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 00:00:34.092607 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 00:00:34.092607 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 00:00:34.092607 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 00:00:34.092607 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 00:00:34.092607 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 00:00:34.092607 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 00:00:34.092607 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 00:00:34.092607 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 893ed869-802c-4a92-b7ab-d2aa8324fb65 could not be found. Sep 13 00:00:34.092607 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:00:34.092607 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 00:00:34.092607 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:00:34.092607 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:00:34.092607 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 00:00:34.092607 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 00:00:34.092607 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 00:00:34.092607 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 00:00:34.092607 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 893ed869-802c-4a92-b7ab-d2aa8324fb65 could not be found. Sep 13 00:00:34.092607 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:00:34.095474 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-edd4d8f9-213c-4fe1-b6ae-6fb2989627b8 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] Returning 404 to user: Instance 893ed869-802c-4a92-b7ab-d2aa8324fb65 could not be found. {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 00:00:34.096575 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-edd4d8f9-213c-4fe1-b6ae-6fb2989627b8 tempest-AttachVolumeShelveTestJSON-895466941 tempest-AttachVolumeShelveTestJSON-895466941-project] 10.222.0.26 "GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65" status: 404 len: 111 microversion: 2.20 time: 0.126975 Sep 13 00:00:34.097644 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 393/790] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Sep 13 00:00:33 2022] GET /compute/v2.1/servers/893ed869-802c-4a92-b7ab-d2aa8324fb65 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 13 00:00:34.418516 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-86c0e4a3-8277-45b9-93c3-ed610c0ce316 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:00:34.425472 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-86c0e4a3-8277-45b9-93c3-ed610c0ce316 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: f7a64139-3e2f-4855-a0d5-a667621b7ded] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:00:34.444213 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-86c0e4a3-8277-45b9-93c3-ed610c0ce316 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:34.450075 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-86c0e4a3-8277-45b9-93c3-ed610c0ce316 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:34.453561 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-86c0e4a3-8277-45b9-93c3-ed610c0ce316 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:34.454923 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-86c0e4a3-8277-45b9-93c3-ed610c0ce316 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:34.455923 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-86c0e4a3-8277-45b9-93c3-ed610c0ce316 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:34.457965 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-86c0e4a3-8277-45b9-93c3-ed610c0ce316 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:34.567512 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-86c0e4a3-8277-45b9-93c3-ed610c0ce316 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.164324 Sep 13 00:00:34.579330 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 398/791] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Sep 13 00:00:34 2022] GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 00:00:34.584457 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ccb4cff0-0535-4e93-aadb-81043aa8a806 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:00:34.585460 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ccb4cff0-0535-4e93-aadb-81043aa8a806 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: f7a64139-3e2f-4855-a0d5-a667621b7ded] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:00:34.598617 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ccb4cff0-0535-4e93-aadb-81043aa8a806 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:34.599134 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ccb4cff0-0535-4e93-aadb-81043aa8a806 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:34.599599 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ccb4cff0-0535-4e93-aadb-81043aa8a806 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:34.600329 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ccb4cff0-0535-4e93-aadb-81043aa8a806 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:34.600862 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ccb4cff0-0535-4e93-aadb-81043aa8a806 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:34.601313 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ccb4cff0-0535-4e93-aadb-81043aa8a806 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:34.660477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ccb4cff0-0535-4e93-aadb-81043aa8a806 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded/os-volume_attachments/346a3f63-fb30-45a5-80a2-169db40bc5b9" status: 200 len: 194 microversion: 2.1 time: 0.080908 Sep 13 00:00:34.683325 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 394/792] 10.222.0.26 () {58 vars in 1413 bytes} [Tue Sep 13 00:00:34 2022] GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded/os-volume_attachments/346a3f63-fb30-45a5-80a2-169db40bc5b9 => generated 194 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 00:00:36.343863 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-291d0d2a-2eb5-48aa-9eb5-0470ba7b60f5 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6b464653-ea24-4178-9d4c-b323422b6efa"}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 00:00:36.346960 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-291d0d2a-2eb5-48aa-9eb5-0470ba7b60f5 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: f7a64139-3e2f-4855-a0d5-a667621b7ded] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:00:36.354473 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-291d0d2a-2eb5-48aa-9eb5-0470ba7b60f5 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:36.355292 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-291d0d2a-2eb5-48aa-9eb5-0470ba7b60f5 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:36.362965 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-291d0d2a-2eb5-48aa-9eb5-0470ba7b60f5 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:36.364200 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-291d0d2a-2eb5-48aa-9eb5-0470ba7b60f5 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:36.365503 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-291d0d2a-2eb5-48aa-9eb5-0470ba7b60f5 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:36.366300 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-291d0d2a-2eb5-48aa-9eb5-0470ba7b60f5 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:36.908206 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-291d0d2a-2eb5-48aa-9eb5-0470ba7b60f5 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "POST /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.569586 Sep 13 00:00:36.917965 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 399/793] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Sep 13 00:00:36 2022] POST /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded/os-volume_attachments => generated 194 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 00:00:42.550356 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7db5f9af-91ee-438a-9a29-8ec49f2961ca tempest-VolumesGetTestJSON-1975653698 tempest-VolumesGetTestJSON-1975653698-project] Action: 'create', calling method: .version_select at 0x7fed0140c310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1925936622", "metadata": {"Type": "work"}}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 00:00:43.101275 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7db5f9af-91ee-438a-9a29-8ec49f2961ca tempest-VolumesGetTestJSON-1975653698 tempest-VolumesGetTestJSON-1975653698-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.788132 Sep 13 00:00:43.105631 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 395/794] 10.222.0.26 () {60 vars in 1156 bytes} [Tue Sep 13 00:00:42 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 794 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 13 00:00:43.119660 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f3322d60-6d02-4c30-b89b-977be6965905 tempest-VolumesGetTestJSON-1975653698 tempest-VolumesGetTestJSON-1975653698-project] Calling method '.version_select at 0x7fed01287dc0>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:00:43.458314 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f3322d60-6d02-4c30-b89b-977be6965905 tempest-VolumesGetTestJSON-1975653698 tempest-VolumesGetTestJSON-1975653698-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/e995472f-6abd-43b4-b8fb-6bb1e96d13f8" status: 200 len: 353 microversion: 2.1 time: 0.344037 Sep 13 00:00:43.459010 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 400/795] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Sep 13 00:00:43 2022] GET /compute/v2.1/os-volumes/e995472f-6abd-43b4-b8fb-6bb1e96d13f8 => generated 353 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 00:00:44.474500 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a72b7b51-6be0-4da4-a8be-8e910132a64d tempest-VolumesGetTestJSON-1975653698 tempest-VolumesGetTestJSON-1975653698-project] Calling method '.version_select at 0x7fed0120c8b0>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:00:44.538362 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a72b7b51-6be0-4da4-a8be-8e910132a64d tempest-VolumesGetTestJSON-1975653698 tempest-VolumesGetTestJSON-1975653698-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/e995472f-6abd-43b4-b8fb-6bb1e96d13f8" status: 200 len: 354 microversion: 2.1 time: 0.068289 Sep 13 00:00:44.554490 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 396/796] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Sep 13 00:00:44 2022] GET /compute/v2.1/os-volumes/e995472f-6abd-43b4-b8fb-6bb1e96d13f8 => generated 354 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 00:00:44.557193 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-67046337-d085-4bf7-ac6b-8004a276a983 tempest-VolumesGetTestJSON-1975653698 tempest-VolumesGetTestJSON-1975653698-project] Calling method '.version_select at 0x7fed012a6160>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:00:44.647799 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-67046337-d085-4bf7-ac6b-8004a276a983 tempest-VolumesGetTestJSON-1975653698 tempest-VolumesGetTestJSON-1975653698-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/e995472f-6abd-43b4-b8fb-6bb1e96d13f8" status: 200 len: 354 microversion: 2.1 time: 0.096999 Sep 13 00:00:44.660728 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 401/797] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Sep 13 00:00:44 2022] GET /compute/v2.1/os-volumes/e995472f-6abd-43b4-b8fb-6bb1e96d13f8 => generated 354 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 00:00:44.666248 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:44.667022 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=21 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:44.671419 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-cb8ddaa3-8c5e-4588-aaa6-3bf7f8fd6329 tempest-VolumesGetTestJSON-1975653698 tempest-VolumesGetTestJSON-1975653698-project] Calling method '.version_select at 0x7fed0120cdc0>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:00:44.783706 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-cb8ddaa3-8c5e-4588-aaa6-3bf7f8fd6329 tempest-VolumesGetTestJSON-1975653698 tempest-VolumesGetTestJSON-1975653698-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/e995472f-6abd-43b4-b8fb-6bb1e96d13f8" status: 202 len: 0 microversion: 2.1 time: 0.117989 Sep 13 00:00:44.785201 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 397/798] 10.222.0.26 () {58 vars in 1248 bytes} [Tue Sep 13 00:00:44 2022] DELETE /compute/v2.1/os-volumes/e995472f-6abd-43b4-b8fb-6bb1e96d13f8 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 00:00:44.795719 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-35b53184-b67e-4f1f-bb61-ec0bdd820253 tempest-VolumesGetTestJSON-1975653698 tempest-VolumesGetTestJSON-1975653698-project] Calling method '.version_select at 0x7fed0126e280>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:00:44.920219 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-35b53184-b67e-4f1f-bb61-ec0bdd820253 tempest-VolumesGetTestJSON-1975653698 tempest-VolumesGetTestJSON-1975653698-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/e995472f-6abd-43b4-b8fb-6bb1e96d13f8" status: 200 len: 353 microversion: 2.1 time: 0.129208 Sep 13 00:00:44.921397 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 402/799] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Sep 13 00:00:44 2022] GET /compute/v2.1/os-volumes/e995472f-6abd-43b4-b8fb-6bb1e96d13f8 => generated 353 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 00:00:44.966786 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4233cacc-9cbc-4f92-b66e-6229a28af773 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:00:44.974249 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-4233cacc-9cbc-4f92-b66e-6229a28af773 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: f7a64139-3e2f-4855-a0d5-a667621b7ded] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:00:44.996490 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4233cacc-9cbc-4f92-b66e-6229a28af773 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:44.998060 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4233cacc-9cbc-4f92-b66e-6229a28af773 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:45.004563 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4233cacc-9cbc-4f92-b66e-6229a28af773 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:45.005894 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4233cacc-9cbc-4f92-b66e-6229a28af773 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:45.007771 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4233cacc-9cbc-4f92-b66e-6229a28af773 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:45.008857 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4233cacc-9cbc-4f92-b66e-6229a28af773 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:45.071165 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-4233cacc-9cbc-4f92-b66e-6229a28af773 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.111524 Sep 13 00:00:45.072657 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 398/800] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Sep 13 00:00:44 2022] GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded/os-volume_attachments => generated 371 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 00:00:45.225084 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a1bddc2c-cdde-4686-8b49-2094705aaffb tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:00:45.227012 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a1bddc2c-cdde-4686-8b49-2094705aaffb tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: f7a64139-3e2f-4855-a0d5-a667621b7ded] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:00:45.238090 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=30 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:45.240316 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a1bddc2c-cdde-4686-8b49-2094705aaffb tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:45.240841 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a1bddc2c-cdde-4686-8b49-2094705aaffb tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:45.241279 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a1bddc2c-cdde-4686-8b49-2094705aaffb tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:45.242855 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a1bddc2c-cdde-4686-8b49-2094705aaffb tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:45.243587 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a1bddc2c-cdde-4686-8b49-2094705aaffb tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:45.244608 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a1bddc2c-cdde-4686-8b49-2094705aaffb tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:45.250873 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:00:45.292812 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a1bddc2c-cdde-4686-8b49-2094705aaffb tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded/os-volume_attachments/346a3f63-fb30-45a5-80a2-169db40bc5b9" status: 200 len: 194 microversion: 2.1 time: 0.072586 Sep 13 00:00:45.303632 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 403/801] 10.222.0.26 () {58 vars in 1413 bytes} [Tue Sep 13 00:00:45 2022] GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded/os-volume_attachments/346a3f63-fb30-45a5-80a2-169db40bc5b9 => generated 194 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 00:00:45.310989 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0c1d6463-42f7-49a8-abd4-b90844b6870b tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:00:45.311603 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0c1d6463-42f7-49a8-abd4-b90844b6870b tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: f7a64139-3e2f-4855-a0d5-a667621b7ded] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:00:45.334797 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c1d6463-42f7-49a8-abd4-b90844b6870b tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:45.336448 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c1d6463-42f7-49a8-abd4-b90844b6870b tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:45.340053 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c1d6463-42f7-49a8-abd4-b90844b6870b tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:45.342489 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c1d6463-42f7-49a8-abd4-b90844b6870b tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:45.343322 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c1d6463-42f7-49a8-abd4-b90844b6870b tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:45.351018 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c1d6463-42f7-49a8-abd4-b90844b6870b tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:45.486124 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.objects.instance [None req-0c1d6463-42f7-49a8-abd4-b90844b6870b tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lazy-loading 'services' on Instance uuid f7a64139-3e2f-4855-a0d5-a667621b7ded {{(pid=126976) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 00:00:45.595297 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0c1d6463-42f7-49a8-abd4-b90844b6870b tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded/os-volume_attachments/346a3f63-fb30-45a5-80a2-169db40bc5b9" status: 202 len: 0 microversion: 2.1 time: 0.288033 Sep 13 00:00:45.596937 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 399/802] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Sep 13 00:00:45 2022] DELETE /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded/os-volume_attachments/346a3f63-fb30-45a5-80a2-169db40bc5b9 => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 00:00:45.937404 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7b863b76-37b8-4790-9f88-58de5542a1aa tempest-VolumesGetTestJSON-1975653698 tempest-VolumesGetTestJSON-1975653698-project] Calling method '.version_select at 0x7fed01406c10>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:00:45.989568 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-7b863b76-37b8-4790-9f88-58de5542a1aa tempest-VolumesGetTestJSON-1975653698 tempest-VolumesGetTestJSON-1975653698-project] HTTP exception thrown: Volume e995472f-6abd-43b4-b8fb-6bb1e96d13f8 could not be found. Sep 13 00:00:45.991721 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7b863b76-37b8-4790-9f88-58de5542a1aa tempest-VolumesGetTestJSON-1975653698 tempest-VolumesGetTestJSON-1975653698-project] Request method failure captured: Sep 13 00:00:45.991721 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: request: GET /compute/v2.1/os-volumes/e995472f-6abd-43b4-b8fb-6bb1e96d13f8 HTTP/1.1 Sep 13 00:00:45.991721 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept: application/json Sep 13 00:00:45.991721 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Sep 13 00:00:45.991721 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Connection: close Sep 13 00:00:45.991721 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Length: 0 Sep 13 00:00:45.991721 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Type: application/json Sep 13 00:00:45.991721 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Host: 10.222.0.26 Sep 13 00:00:45.991721 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Sep 13 00:00:45.991721 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Sep 13 00:00:45.991721 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjH8gqrqKOSw3fOJUz9_y6YkBCXfH7JDcfSD1zHFxIy6vCgYoFdBl_-eYEk_UIblg7yeuCrpjbLqcChcNgzOe9XbUa3af1iR63nSYSb2JxSlT5EkdxIgGEok2pvsVziQJSjZIQGXbeY7tshEWP3bcVn5zEdYK0shOYxke67fcXg-Ggs6g Sep 13 00:00:45.991721 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Sep 13 00:00:45.991721 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Sep 13 00:00:45.991721 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Sep 13 00:00:45.991721 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Sep 13 00:00:45.991721 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Sep 13 00:00:45.991721 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Sep 13 00:00:45.991721 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Id: c3f8028d6272470f99135b302b72bae7 Sep 13 00:00:45.991721 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-VolumesGetTestJSON-1975653698 Sep 13 00:00:45.991721 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Role: member,reader Sep 13 00:00:45.991721 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Roles: member,reader Sep 13 00:00:45.993507 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c3f8028d6272470f99135b302b72bae7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c3f8028d6272470f99135b302b72bae7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c3f8028d6272470f99135b302b72bae7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c3f8028d6272470f99135b302b72bae7"}]}] Sep 13 00:00:45.993507 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-VolumesGetTestJSON-1975653698 Sep 13 00:00:45.993507 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Id: c3f8028d6272470f99135b302b72bae7 Sep 13 00:00:45.993507 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-VolumesGetTestJSON-1975653698 Sep 13 00:00:45.993507 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User: tempest-VolumesGetTestJSON-1975653698-project Sep 13 00:00:45.993507 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Sep 13 00:00:45.993507 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Sep 13 00:00:45.993507 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Id: 8463f36f6b194e67aa1652f68c698a47 Sep 13 00:00:45.993507 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-VolumesGetTestJSON-1975653698-project Sep 13 00:00:45.993507 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: method: Sep 13 00:00:45.993507 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: exception: Volume e995472f-6abd-43b4-b8fb-6bb1e96d13f8 could not be found. Sep 13 00:00:45.993507 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: action_args: {'id': 'e995472f-6abd-43b4-b8fb-6bb1e96d13f8'} Sep 13 00:00:45.993507 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 00:00:45.994577 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:00:45.994577 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 00:00:45.994577 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 00:00:45.994577 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 00:00:45.994577 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 00:00:45.994577 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 00:00:45.994577 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 00:00:45.994577 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 00:00:45.994577 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 00:00:45.994577 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 00:00:45.994577 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 00:00:45.994577 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 00:00:45.994577 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 00:00:45.994577 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 00:00:45.994577 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 00:00:45.994577 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e995472f-6abd-43b4-b8fb-6bb1e96d13f8 could not be found. (HTTP 404) (Request-ID: req-d7eba5ab-3287-4cc1-9b8c-7a80a3d05140) Sep 13 00:00:45.994577 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:00:45.994577 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 00:00:45.994577 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:00:45.996211 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:00:45.996211 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 00:00:45.996211 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 00:00:45.996211 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 00:00:45.996211 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 00:00:45.996211 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 00:00:45.996211 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 00:00:45.996211 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 00:00:45.996211 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 00:00:45.996211 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 00:00:45.996211 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 00:00:45.996211 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 00:00:45.996211 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 00:00:45.996211 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 00:00:45.996211 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 00:00:45.996211 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 00:00:45.996211 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 00:00:45.996211 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 00:00:45.996211 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 00:00:45.997481 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 00:00:45.997481 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 00:00:45.997481 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 00:00:45.997481 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 00:00:45.997481 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e995472f-6abd-43b4-b8fb-6bb1e96d13f8 could not be found. Sep 13 00:00:45.997481 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:00:45.997481 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 00:00:45.997481 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:00:45.997481 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:00:45.997481 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 00:00:45.997481 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 00:00:45.997481 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 00:00:45.997481 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 00:00:45.997481 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 00:00:45.997481 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 00:00:45.997481 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 00:00:45.997481 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 00:00:45.997481 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 00:00:45.997481 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 00:00:45.998733 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e995472f-6abd-43b4-b8fb-6bb1e96d13f8 could not be found. Sep 13 00:00:45.998733 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:00:45.998733 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 00:00:45.998733 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:00:45.998733 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:00:45.998733 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 00:00:45.998733 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 00:00:45.998733 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 00:00:45.998733 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 00:00:45.998733 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e995472f-6abd-43b4-b8fb-6bb1e96d13f8 could not be found. Sep 13 00:00:45.998733 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:00:45.998733 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7b863b76-37b8-4790-9f88-58de5542a1aa tempest-VolumesGetTestJSON-1975653698 tempest-VolumesGetTestJSON-1975653698-project] Returning 404 to user: Volume e995472f-6abd-43b4-b8fb-6bb1e96d13f8 could not be found. {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 00:00:45.998733 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7b863b76-37b8-4790-9f88-58de5542a1aa tempest-VolumesGetTestJSON-1975653698 tempest-VolumesGetTestJSON-1975653698-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/e995472f-6abd-43b4-b8fb-6bb1e96d13f8" status: 404 len: 109 microversion: 2.1 time: 0.060242 Sep 13 00:00:45.998733 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 404/803] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Sep 13 00:00:45 2022] GET /compute/v2.1/os-volumes/e995472f-6abd-43b4-b8fb-6bb1e96d13f8 => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 00:00:46.845982 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f9f4633d-24f4-4630-9439-ac3d008368d2 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:00:46.849925 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f9f4633d-24f4-4630-9439-ac3d008368d2 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: f7a64139-3e2f-4855-a0d5-a667621b7ded] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:00:46.873296 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f9f4633d-24f4-4630-9439-ac3d008368d2 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:46.874463 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f9f4633d-24f4-4630-9439-ac3d008368d2 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:46.874988 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f9f4633d-24f4-4630-9439-ac3d008368d2 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:46.875924 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f9f4633d-24f4-4630-9439-ac3d008368d2 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:46.876912 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f9f4633d-24f4-4630-9439-ac3d008368d2 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:46.877551 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f9f4633d-24f4-4630-9439-ac3d008368d2 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:46.917441 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f9f4633d-24f4-4630-9439-ac3d008368d2 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded/os-volume_attachments/6b464653-ea24-4178-9d4c-b323422b6efa" status: 200 len: 194 microversion: 2.1 time: 0.079915 Sep 13 00:00:46.918678 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 400/804] 10.222.0.26 () {58 vars in 1413 bytes} [Tue Sep 13 00:00:46 2022] GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded/os-volume_attachments/6b464653-ea24-4178-9d4c-b323422b6efa => generated 194 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 00:00:46.929279 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-71de2d2f-d05a-4046-a685-0b2062de260f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:00:46.929782 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-71de2d2f-d05a-4046-a685-0b2062de260f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: f7a64139-3e2f-4855-a0d5-a667621b7ded] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:00:46.940005 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-71de2d2f-d05a-4046-a685-0b2062de260f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:46.940720 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-71de2d2f-d05a-4046-a685-0b2062de260f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:46.940925 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-71de2d2f-d05a-4046-a685-0b2062de260f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:46.955194 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-71de2d2f-d05a-4046-a685-0b2062de260f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:46.955728 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-71de2d2f-d05a-4046-a685-0b2062de260f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:46.956223 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-71de2d2f-d05a-4046-a685-0b2062de260f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:47.172440 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.objects.instance [None req-71de2d2f-d05a-4046-a685-0b2062de260f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lazy-loading 'services' on Instance uuid f7a64139-3e2f-4855-a0d5-a667621b7ded {{(pid=126975) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 00:00:47.275405 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-71de2d2f-d05a-4046-a685-0b2062de260f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded/os-volume_attachments/6b464653-ea24-4178-9d4c-b323422b6efa" status: 202 len: 0 microversion: 2.1 time: 0.349774 Sep 13 00:00:47.276817 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 405/805] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Sep 13 00:00:46 2022] DELETE /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded/os-volume_attachments/6b464653-ea24-4178-9d4c-b323422b6efa => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 00:00:48.485336 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0c25d072-d79c-4c2a-aaa2-4123f3b85669 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:00:48.488654 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0c25d072-d79c-4c2a-aaa2-4123f3b85669 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: f7a64139-3e2f-4855-a0d5-a667621b7ded] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:00:48.496998 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c25d072-d79c-4c2a-aaa2-4123f3b85669 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:48.497676 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c25d072-d79c-4c2a-aaa2-4123f3b85669 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:48.498339 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c25d072-d79c-4c2a-aaa2-4123f3b85669 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:48.499154 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c25d072-d79c-4c2a-aaa2-4123f3b85669 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:48.499913 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c25d072-d79c-4c2a-aaa2-4123f3b85669 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:48.500588 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c25d072-d79c-4c2a-aaa2-4123f3b85669 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:48.553779 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0c25d072-d79c-4c2a-aaa2-4123f3b85669 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067061 Sep 13 00:00:48.554734 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 401/806] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Sep 13 00:00:48 2022] GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded/os-volume_attachments => generated 25 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 00:00:48.728426 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1df41648-d27a-40ca-8851-b5264e074764 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:00:48.730926 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1df41648-d27a-40ca-8851-b5264e074764 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: f7a64139-3e2f-4855-a0d5-a667621b7ded] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:00:48.739309 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1df41648-d27a-40ca-8851-b5264e074764 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:48.739802 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1df41648-d27a-40ca-8851-b5264e074764 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:48.740418 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1df41648-d27a-40ca-8851-b5264e074764 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:48.741144 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1df41648-d27a-40ca-8851-b5264e074764 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:48.741604 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1df41648-d27a-40ca-8851-b5264e074764 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:48.742028 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1df41648-d27a-40ca-8851-b5264e074764 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:48.777845 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1df41648-d27a-40ca-8851-b5264e074764 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053690 Sep 13 00:00:48.778438 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 406/807] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Sep 13 00:00:48 2022] GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 00:00:48.857891 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-750fe837-b86b-4727-a649-2a2fc794b68d tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:00:48.858657 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-750fe837-b86b-4727-a649-2a2fc794b68d tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: f7a64139-3e2f-4855-a0d5-a667621b7ded] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:00:48.865417 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-750fe837-b86b-4727-a649-2a2fc794b68d tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:48.865911 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-750fe837-b86b-4727-a649-2a2fc794b68d tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:48.866343 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-750fe837-b86b-4727-a649-2a2fc794b68d tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:48.867067 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-750fe837-b86b-4727-a649-2a2fc794b68d tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:48.867921 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-750fe837-b86b-4727-a649-2a2fc794b68d tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:48.868521 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-750fe837-b86b-4727-a649-2a2fc794b68d tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:48.897143 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-750fe837-b86b-4727-a649-2a2fc794b68d tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: f7a64139-3e2f-4855-a0d5-a667621b7ded] Going to try to terminate instance {{(pid=126976) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 00:00:48.989263 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-750fe837-b86b-4727-a649-2a2fc794b68d tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded" status: 204 len: 0 microversion: 2.1 time: 0.134641 Sep 13 00:00:48.990483 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 402/808] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Sep 13 00:00:48 2022] DELETE /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 00:00:49.001185 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-452c2265-3f72-4bcd-965b-c2433c20f6c2 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:00:49.001904 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-452c2265-3f72-4bcd-965b-c2433c20f6c2 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: f7a64139-3e2f-4855-a0d5-a667621b7ded] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:00:49.011867 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-452c2265-3f72-4bcd-965b-c2433c20f6c2 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:49.012336 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-452c2265-3f72-4bcd-965b-c2433c20f6c2 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:49.012779 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-452c2265-3f72-4bcd-965b-c2433c20f6c2 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:49.013503 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-452c2265-3f72-4bcd-965b-c2433c20f6c2 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:49.013961 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-452c2265-3f72-4bcd-965b-c2433c20f6c2 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:49.014381 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-452c2265-3f72-4bcd-965b-c2433c20f6c2 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:49.221642 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-452c2265-3f72-4bcd-965b-c2433c20f6c2 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:00:49.239552 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-452c2265-3f72-4bcd-965b-c2433c20f6c2 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded" status: 200 len: 1675 microversion: 2.1 time: 0.240456 Sep 13 00:00:49.240110 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 407/809] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:00:48 2022] GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded => generated 1675 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:00:50.265806 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3f29af85-e84d-4580-9831-33a3b9eb2c9a tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:00:50.267927 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3f29af85-e84d-4580-9831-33a3b9eb2c9a tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: f7a64139-3e2f-4855-a0d5-a667621b7ded] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:00:50.284097 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3f29af85-e84d-4580-9831-33a3b9eb2c9a tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:50.284568 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3f29af85-e84d-4580-9831-33a3b9eb2c9a tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:50.285261 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3f29af85-e84d-4580-9831-33a3b9eb2c9a tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:50.286346 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3f29af85-e84d-4580-9831-33a3b9eb2c9a tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:50.287988 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3f29af85-e84d-4580-9831-33a3b9eb2c9a tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:50.288693 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3f29af85-e84d-4580-9831-33a3b9eb2c9a tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:50.485441 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3f29af85-e84d-4580-9831-33a3b9eb2c9a tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:00:50.493923 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3f29af85-e84d-4580-9831-33a3b9eb2c9a tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded" status: 200 len: 1675 microversion: 2.1 time: 0.234943 Sep 13 00:00:50.494626 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 403/810] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:00:50 2022] GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded => generated 1675 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:00:51.521241 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f1c14cea-9eb5-4789-805e-f24ce69296fe tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:00:51.522206 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f1c14cea-9eb5-4789-805e-f24ce69296fe tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: f7a64139-3e2f-4855-a0d5-a667621b7ded] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:00:51.529878 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f1c14cea-9eb5-4789-805e-f24ce69296fe tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:51.531070 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f1c14cea-9eb5-4789-805e-f24ce69296fe tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:51.531464 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f1c14cea-9eb5-4789-805e-f24ce69296fe tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:51.532949 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f1c14cea-9eb5-4789-805e-f24ce69296fe tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:51.533746 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f1c14cea-9eb5-4789-805e-f24ce69296fe tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:51.534157 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f1c14cea-9eb5-4789-805e-f24ce69296fe tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:52.368626 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f1c14cea-9eb5-4789-805e-f24ce69296fe tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:00:52.383253 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f1c14cea-9eb5-4789-805e-f24ce69296fe tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded" status: 200 len: 1675 microversion: 2.1 time: 0.866574 Sep 13 00:00:52.384276 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 408/811] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:00:51 2022] GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded => generated 1675 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:00:52.936712 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-c4a40636-998b-4934-bc76-e0100ffa63e4 req-a9ca7c5b-00f2-493f-b61a-6918a1a80357 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7a64139-3e2f-4855-a0d5-a667621b7ded", "name": "network-vif-deleted", "tag": "179e43ce-b6df-4eaa-9bf7-f66d5c59cb2f"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 00:00:52.952539 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-c4a40636-998b-4934-bc76-e0100ffa63e4 req-a9ca7c5b-00f2-493f-b61a-6918a1a80357 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:52.953126 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-c4a40636-998b-4934-bc76-e0100ffa63e4 req-a9ca7c5b-00f2-493f-b61a-6918a1a80357 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:52.953748 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-c4a40636-998b-4934-bc76-e0100ffa63e4 req-a9ca7c5b-00f2-493f-b61a-6918a1a80357 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:52.968588 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-c4a40636-998b-4934-bc76-e0100ffa63e4 req-a9ca7c5b-00f2-493f-b61a-6918a1a80357 service nova] Creating event network-vif-deleted:179e43ce-b6df-4eaa-9bf7-f66d5c59cb2f for instance f7a64139-3e2f-4855-a0d5-a667621b7ded on hv-cinder-82002 Sep 13 00:00:52.976508 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-c4a40636-998b-4934-bc76-e0100ffa63e4 req-a9ca7c5b-00f2-493f-b61a-6918a1a80357 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043708 Sep 13 00:00:52.979423 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 404/812] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 13 00:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 00:00:53.414419 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-58d3ed66-a215-43a3-ab02-640508647a60 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:00:53.416444 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-58d3ed66-a215-43a3-ab02-640508647a60 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: f7a64139-3e2f-4855-a0d5-a667621b7ded] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:00:53.427815 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-58d3ed66-a215-43a3-ab02-640508647a60 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:53.428994 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-58d3ed66-a215-43a3-ab02-640508647a60 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:53.430012 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-58d3ed66-a215-43a3-ab02-640508647a60 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:53.431572 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-58d3ed66-a215-43a3-ab02-640508647a60 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:53.432648 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-58d3ed66-a215-43a3-ab02-640508647a60 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:53.433632 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-58d3ed66-a215-43a3-ab02-640508647a60 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:53.486529 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-58d3ed66-a215-43a3-ab02-640508647a60 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:53.487027 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-58d3ed66-a215-43a3-ab02-640508647a60 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:53.487517 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-58d3ed66-a215-43a3-ab02-640508647a60 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:53.488032 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.objects.instance [None req-58d3ed66-a215-43a3-ab02-640508647a60 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lazy-loading 'fault' on Instance uuid f7a64139-3e2f-4855-a0d5-a667621b7ded {{(pid=126975) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 00:00:53.564512 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-58d3ed66-a215-43a3-ab02-640508647a60 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d81b048f7e64c53894ad9e9ee33f518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5ce52ae574b82bda143e766bcec80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:00:53.573850 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-58d3ed66-a215-43a3-ab02-640508647a60 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded" status: 200 len: 1328 microversion: 2.1 time: 0.166359 Sep 13 00:00:53.575029 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 409/813] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:00:53 2022] GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded => generated 1328 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:00:54.609821 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-be273db3-d8f1-40fb-bd38-569f5332bccc tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:00:54.611993 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-be273db3-d8f1-40fb-bd38-569f5332bccc tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: f7a64139-3e2f-4855-a0d5-a667621b7ded] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:00:54.623551 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-be273db3-d8f1-40fb-bd38-569f5332bccc tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:54.624971 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-be273db3-d8f1-40fb-bd38-569f5332bccc tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:54.625986 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-be273db3-d8f1-40fb-bd38-569f5332bccc tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:54.627868 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-be273db3-d8f1-40fb-bd38-569f5332bccc tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:00:54.629017 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-be273db3-d8f1-40fb-bd38-569f5332bccc tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:00:54.630043 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-be273db3-d8f1-40fb-bd38-569f5332bccc tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:00:54.663258 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-be273db3-d8f1-40fb-bd38-569f5332bccc tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] HTTP exception thrown: Instance f7a64139-3e2f-4855-a0d5-a667621b7ded could not be found. Sep 13 00:00:54.665865 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-be273db3-d8f1-40fb-bd38-569f5332bccc tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Request method failure captured: Sep 13 00:00:54.665865 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: request: GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded HTTP/1.1 Sep 13 00:00:54.665865 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Accept: application/json Sep 13 00:00:54.665865 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Sep 13 00:00:54.665865 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Connection: close Sep 13 00:00:54.665865 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Content-Length: 0 Sep 13 00:00:54.665865 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Content-Type: application/json Sep 13 00:00:54.665865 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Host: 10.222.0.26 Sep 13 00:00:54.665865 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Sep 13 00:00:54.665865 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Sep 13 00:00:54.665865 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjH8bc4bJdVDTQjQ-S_BrNKXiAQaJrogJrt6IBcOL1djQpAvT8zwXOYVZlnrngFM7OG_4Ir8seGcj-mSqgkiw6n-dR85_T4cZlf5h7G8ApBZL33D25KZPqSRXq1fcMYh9s_4RqV8zn646ssP0OB_eBcWsbUyrEYN7lSok4iWBOPJYkWAE Sep 13 00:00:54.665865 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Sep 13 00:00:54.665865 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Sep 13 00:00:54.665865 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Sep 13 00:00:54.665865 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Sep 13 00:00:54.665865 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Sep 13 00:00:54.665865 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Sep 13 00:00:54.665865 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Id: ffc5ce52ae574b82bda143e766bcec80 Sep 13 00:00:54.665865 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-AttachVolumeTestJSON-1068932957 Sep 13 00:00:54.665865 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Role: member,reader Sep 13 00:00:54.665865 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Roles: member,reader Sep 13 00:00:54.667589 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ffc5ce52ae574b82bda143e766bcec80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ffc5ce52ae574b82bda143e766bcec80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ffc5ce52ae574b82bda143e766bcec80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ffc5ce52ae574b82bda143e766bcec80"}]}] Sep 13 00:00:54.667589 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-AttachVolumeTestJSON-1068932957 Sep 13 00:00:54.667589 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant-Id: ffc5ce52ae574b82bda143e766bcec80 Sep 13 00:00:54.667589 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1068932957 Sep 13 00:00:54.667589 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User: tempest-AttachVolumeTestJSON-1068932957-project Sep 13 00:00:54.667589 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Sep 13 00:00:54.667589 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Sep 13 00:00:54.667589 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Id: 0d81b048f7e64c53894ad9e9ee33f518 Sep 13 00:00:54.667589 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-AttachVolumeTestJSON-1068932957-project Sep 13 00:00:54.667589 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: method: > Sep 13 00:00:54.667589 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: exception: Instance f7a64139-3e2f-4855-a0d5-a667621b7ded could not be found. Sep 13 00:00:54.667589 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: action_args: {'id': 'f7a64139-3e2f-4855-a0d5-a667621b7ded'} Sep 13 00:00:54.668565 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 00:00:54.668565 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:00:54.668565 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 00:00:54.668565 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 00:00:54.668565 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 00:00:54.668565 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 00:00:54.668565 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 00:00:54.668565 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 00:00:54.668565 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 00:00:54.668565 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 00:00:54.668565 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7a64139-3e2f-4855-a0d5-a667621b7ded could not be found. Sep 13 00:00:54.668565 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:00:54.668565 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 00:00:54.668565 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:00:54.668565 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:00:54.668565 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 00:00:54.668565 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 00:00:54.668565 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 00:00:54.668565 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 00:00:54.668565 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 00:00:54.670111 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 00:00:54.670111 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 00:00:54.670111 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 00:00:54.670111 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 00:00:54.670111 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 00:00:54.670111 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 00:00:54.670111 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 00:00:54.670111 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7a64139-3e2f-4855-a0d5-a667621b7ded could not be found. Sep 13 00:00:54.670111 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:00:54.670111 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 00:00:54.670111 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:00:54.670111 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:00:54.670111 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 00:00:54.670111 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 00:00:54.670111 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 00:00:54.670111 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 00:00:54.670111 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7a64139-3e2f-4855-a0d5-a667621b7ded could not be found. Sep 13 00:00:54.670111 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:00:54.671314 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-be273db3-d8f1-40fb-bd38-569f5332bccc tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Returning 404 to user: Instance f7a64139-3e2f-4855-a0d5-a667621b7ded could not be found. {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 00:00:54.671314 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-be273db3-d8f1-40fb-bd38-569f5332bccc tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded" status: 404 len: 111 microversion: 2.1 time: 0.067037 Sep 13 00:00:54.671314 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 405/814] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:00:54 2022] GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 00:00:54.686698 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-325fe0a3-6df8-48ef-b2d6-8125d0da5e66 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '.version_select at 0x7fed012ca1f0>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:00:54.718931 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-325fe0a3-6df8-48ef-b2d6-8125d0da5e66 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1991911507" status: 202 len: 0 microversion: 2.1 time: 0.038712 Sep 13 00:00:54.726128 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 410/815] 10.222.0.26 () {58 vars in 1221 bytes} [Tue Sep 13 00:00:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1991911507 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 00:01:01.283318 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5cbefa33-553c-4960-89e1-f116f89ac38f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:01:01.284197 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5cbefa33-553c-4960-89e1-f116f89ac38f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: f7a64139-3e2f-4855-a0d5-a667621b7ded] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:01:01.291580 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5cbefa33-553c-4960-89e1-f116f89ac38f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:01:01.292049 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5cbefa33-553c-4960-89e1-f116f89ac38f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:01:01.292471 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5cbefa33-553c-4960-89e1-f116f89ac38f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:01:01.293182 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5cbefa33-553c-4960-89e1-f116f89ac38f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:01:01.293750 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5cbefa33-553c-4960-89e1-f116f89ac38f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:01:01.294243 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-5cbefa33-553c-4960-89e1-f116f89ac38f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:01:01.310232 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-5cbefa33-553c-4960-89e1-f116f89ac38f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] HTTP exception thrown: Instance f7a64139-3e2f-4855-a0d5-a667621b7ded could not be found. Sep 13 00:01:01.311842 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5cbefa33-553c-4960-89e1-f116f89ac38f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Request method failure captured: Sep 13 00:01:01.311842 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: request: DELETE /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded HTTP/1.1 Sep 13 00:01:01.311842 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Accept: application/json Sep 13 00:01:01.311842 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Sep 13 00:01:01.311842 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Connection: close Sep 13 00:01:01.311842 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Content-Length: 0 Sep 13 00:01:01.311842 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Content-Type: application/json Sep 13 00:01:01.311842 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Host: 10.222.0.26 Sep 13 00:01:01.311842 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Sep 13 00:01:01.311842 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Sep 13 00:01:01.311842 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjH8bc4bJdVDTQjQ-S_BrNKXiAQaJrogJrt6IBcOL1djQpAvT8zwXOYVZlnrngFM7OG_4Ir8seGcj-mSqgkiw6n-dR85_T4cZlf5h7G8ApBZL33D25KZPqSRXq1fcMYh9s_4RqV8zn646ssP0OB_eBcWsbUyrEYN7lSok4iWBOPJYkWAE Sep 13 00:01:01.311842 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Sep 13 00:01:01.311842 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Sep 13 00:01:01.311842 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Sep 13 00:01:01.311842 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Sep 13 00:01:01.311842 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Sep 13 00:01:01.311842 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Sep 13 00:01:01.311842 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Id: ffc5ce52ae574b82bda143e766bcec80 Sep 13 00:01:01.311842 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-AttachVolumeTestJSON-1068932957 Sep 13 00:01:01.311842 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Role: member,reader Sep 13 00:01:01.311842 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Roles: member,reader Sep 13 00:01:01.314762 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ffc5ce52ae574b82bda143e766bcec80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ffc5ce52ae574b82bda143e766bcec80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ffc5ce52ae574b82bda143e766bcec80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ffc5ce52ae574b82bda143e766bcec80"}]}] Sep 13 00:01:01.314762 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-AttachVolumeTestJSON-1068932957 Sep 13 00:01:01.314762 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant-Id: ffc5ce52ae574b82bda143e766bcec80 Sep 13 00:01:01.314762 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1068932957 Sep 13 00:01:01.314762 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User: tempest-AttachVolumeTestJSON-1068932957-project Sep 13 00:01:01.314762 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Sep 13 00:01:01.314762 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Sep 13 00:01:01.314762 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Id: 0d81b048f7e64c53894ad9e9ee33f518 Sep 13 00:01:01.314762 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-AttachVolumeTestJSON-1068932957-project Sep 13 00:01:01.314762 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: method: > Sep 13 00:01:01.314762 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: exception: Instance f7a64139-3e2f-4855-a0d5-a667621b7ded could not be found. Sep 13 00:01:01.314762 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: action_args: {'id': 'f7a64139-3e2f-4855-a0d5-a667621b7ded'} Sep 13 00:01:01.317339 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 00:01:01.317339 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:01:01.317339 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 00:01:01.317339 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 00:01:01.317339 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 00:01:01.317339 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 00:01:01.317339 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 00:01:01.317339 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 00:01:01.317339 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 00:01:01.317339 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 00:01:01.317339 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7a64139-3e2f-4855-a0d5-a667621b7ded could not be found. Sep 13 00:01:01.317339 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:01:01.317339 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 00:01:01.317339 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:01:01.317339 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:01:01.317339 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 00:01:01.317339 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 00:01:01.317339 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 00:01:01.317339 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 00:01:01.317339 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 00:01:01.320460 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 00:01:01.320460 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 00:01:01.320460 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 00:01:01.320460 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 00:01:01.320460 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 00:01:01.320460 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 00:01:01.320460 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 00:01:01.320460 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 00:01:01.320460 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 00:01:01.320460 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7a64139-3e2f-4855-a0d5-a667621b7ded could not be found. Sep 13 00:01:01.320460 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:01:01.320460 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 00:01:01.320460 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:01:01.320460 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:01:01.320460 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 00:01:01.320460 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 00:01:01.320460 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 00:01:01.320460 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 00:01:01.320460 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7a64139-3e2f-4855-a0d5-a667621b7ded could not be found. Sep 13 00:01:01.320460 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:01:01.324457 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5cbefa33-553c-4960-89e1-f116f89ac38f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Returning 404 to user: Instance f7a64139-3e2f-4855-a0d5-a667621b7ded could not be found. {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 00:01:01.324457 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5cbefa33-553c-4960-89e1-f116f89ac38f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded" status: 404 len: 111 microversion: 2.1 time: 0.034550 Sep 13 00:01:01.324457 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 406/816] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Sep 13 00:01:01 2022] DELETE /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 00:01:01.325117 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4784a0c2-29a3-4ac4-83f0-59e149bc7f77 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:01:01.326072 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4784a0c2-29a3-4ac4-83f0-59e149bc7f77 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: f7a64139-3e2f-4855-a0d5-a667621b7ded] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:01:01.337620 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4784a0c2-29a3-4ac4-83f0-59e149bc7f77 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:01:01.338287 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4784a0c2-29a3-4ac4-83f0-59e149bc7f77 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:01:01.339102 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4784a0c2-29a3-4ac4-83f0-59e149bc7f77 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:01:01.339471 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4784a0c2-29a3-4ac4-83f0-59e149bc7f77 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:01:01.340070 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4784a0c2-29a3-4ac4-83f0-59e149bc7f77 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:01:01.341616 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4784a0c2-29a3-4ac4-83f0-59e149bc7f77 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:01:01.355508 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-4784a0c2-29a3-4ac4-83f0-59e149bc7f77 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] HTTP exception thrown: Instance f7a64139-3e2f-4855-a0d5-a667621b7ded could not be found. Sep 13 00:01:01.357185 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4784a0c2-29a3-4ac4-83f0-59e149bc7f77 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Request method failure captured: Sep 13 00:01:01.357185 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: request: GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded HTTP/1.1 Sep 13 00:01:01.357185 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept: application/json Sep 13 00:01:01.357185 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Sep 13 00:01:01.357185 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Connection: close Sep 13 00:01:01.357185 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Length: 0 Sep 13 00:01:01.357185 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Type: application/json Sep 13 00:01:01.357185 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Host: 10.222.0.26 Sep 13 00:01:01.357185 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Sep 13 00:01:01.357185 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Sep 13 00:01:01.357185 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjH8bc4bJdVDTQjQ-S_BrNKXiAQaJrogJrt6IBcOL1djQpAvT8zwXOYVZlnrngFM7OG_4Ir8seGcj-mSqgkiw6n-dR85_T4cZlf5h7G8ApBZL33D25KZPqSRXq1fcMYh9s_4RqV8zn646ssP0OB_eBcWsbUyrEYN7lSok4iWBOPJYkWAE Sep 13 00:01:01.357185 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Sep 13 00:01:01.357185 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Sep 13 00:01:01.357185 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Sep 13 00:01:01.357185 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Sep 13 00:01:01.357185 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Sep 13 00:01:01.357185 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Sep 13 00:01:01.357185 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Id: ffc5ce52ae574b82bda143e766bcec80 Sep 13 00:01:01.357185 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-AttachVolumeTestJSON-1068932957 Sep 13 00:01:01.357185 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Role: member,reader Sep 13 00:01:01.357185 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Roles: member,reader Sep 13 00:01:01.360040 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ffc5ce52ae574b82bda143e766bcec80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ffc5ce52ae574b82bda143e766bcec80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ffc5ce52ae574b82bda143e766bcec80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ffc5ce52ae574b82bda143e766bcec80"}]}] Sep 13 00:01:01.360040 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-AttachVolumeTestJSON-1068932957 Sep 13 00:01:01.360040 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Id: ffc5ce52ae574b82bda143e766bcec80 Sep 13 00:01:01.360040 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1068932957 Sep 13 00:01:01.360040 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User: tempest-AttachVolumeTestJSON-1068932957-project Sep 13 00:01:01.360040 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Sep 13 00:01:01.360040 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Sep 13 00:01:01.360040 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Id: 0d81b048f7e64c53894ad9e9ee33f518 Sep 13 00:01:01.360040 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-AttachVolumeTestJSON-1068932957-project Sep 13 00:01:01.360040 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: method: > Sep 13 00:01:01.360040 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: exception: Instance f7a64139-3e2f-4855-a0d5-a667621b7ded could not be found. Sep 13 00:01:01.360040 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: action_args: {'id': 'f7a64139-3e2f-4855-a0d5-a667621b7ded'} Sep 13 00:01:01.361665 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 00:01:01.361665 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:01:01.361665 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 00:01:01.361665 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 00:01:01.361665 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 00:01:01.361665 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 00:01:01.361665 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 00:01:01.361665 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 00:01:01.361665 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 00:01:01.361665 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 00:01:01.361665 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7a64139-3e2f-4855-a0d5-a667621b7ded could not be found. Sep 13 00:01:01.361665 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:01:01.361665 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 00:01:01.361665 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:01:01.361665 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:01:01.361665 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 00:01:01.361665 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 00:01:01.361665 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 00:01:01.361665 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 00:01:01.361665 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 00:01:01.364293 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 00:01:01.364293 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 00:01:01.364293 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 00:01:01.364293 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 00:01:01.364293 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 00:01:01.364293 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 00:01:01.364293 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 00:01:01.364293 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7a64139-3e2f-4855-a0d5-a667621b7ded could not be found. Sep 13 00:01:01.364293 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:01:01.364293 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 00:01:01.364293 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:01:01.364293 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:01:01.364293 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 00:01:01.364293 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 00:01:01.364293 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 00:01:01.364293 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 00:01:01.364293 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7a64139-3e2f-4855-a0d5-a667621b7ded could not be found. Sep 13 00:01:01.364293 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:01:01.366615 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4784a0c2-29a3-4ac4-83f0-59e149bc7f77 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Returning 404 to user: Instance f7a64139-3e2f-4855-a0d5-a667621b7ded could not be found. {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 00:01:01.366615 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4784a0c2-29a3-4ac4-83f0-59e149bc7f77 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded" status: 404 len: 111 microversion: 2.1 time: 0.038234 Sep 13 00:01:01.366615 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 411/817] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:01:01 2022] GET /compute/v2.1/servers/f7a64139-3e2f-4855-a0d5-a667621b7ded => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 00:01:02.566170 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-de51ab27-4137-496f-b27c-79a481214e3f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:01:02.566725 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-de51ab27-4137-496f-b27c-79a481214e3f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:01:02.573585 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-de51ab27-4137-496f-b27c-79a481214e3f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:01:02.574082 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-de51ab27-4137-496f-b27c-79a481214e3f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:01:02.574574 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-de51ab27-4137-496f-b27c-79a481214e3f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:01:02.575668 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-de51ab27-4137-496f-b27c-79a481214e3f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:01:02.575789 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-de51ab27-4137-496f-b27c-79a481214e3f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:01:02.576300 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-de51ab27-4137-496f-b27c-79a481214e3f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:01:02.591428 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-de51ab27-4137-496f-b27c-79a481214e3f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] HTTP exception thrown: Instance df2886ea-3e42-4713-82e6-bacd4de26d8c could not be found. Sep 13 00:01:02.593055 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-de51ab27-4137-496f-b27c-79a481214e3f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Request method failure captured: Sep 13 00:01:02.593055 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: request: DELETE /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c HTTP/1.1 Sep 13 00:01:02.593055 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Accept: application/json Sep 13 00:01:02.593055 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Sep 13 00:01:02.593055 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Connection: close Sep 13 00:01:02.593055 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Content-Length: 0 Sep 13 00:01:02.593055 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Content-Type: application/json Sep 13 00:01:02.593055 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Host: 10.222.0.26 Sep 13 00:01:02.593055 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Sep 13 00:01:02.593055 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Sep 13 00:01:02.593055 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjH8bc4bJdVDTQjQ-S_BrNKXiAQaJrogJrt6IBcOL1djQpAvT8zwXOYVZlnrngFM7OG_4Ir8seGcj-mSqgkiw6n-dR85_T4cZlf5h7G8ApBZL33D25KZPqSRXq1fcMYh9s_4RqV8zn646ssP0OB_eBcWsbUyrEYN7lSok4iWBOPJYkWAE Sep 13 00:01:02.593055 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Sep 13 00:01:02.593055 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Sep 13 00:01:02.593055 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Sep 13 00:01:02.593055 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Sep 13 00:01:02.593055 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Sep 13 00:01:02.593055 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Sep 13 00:01:02.593055 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Id: ffc5ce52ae574b82bda143e766bcec80 Sep 13 00:01:02.593055 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-AttachVolumeTestJSON-1068932957 Sep 13 00:01:02.593055 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Role: member,reader Sep 13 00:01:02.593055 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Roles: member,reader Sep 13 00:01:02.594978 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ffc5ce52ae574b82bda143e766bcec80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ffc5ce52ae574b82bda143e766bcec80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ffc5ce52ae574b82bda143e766bcec80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ffc5ce52ae574b82bda143e766bcec80"}]}] Sep 13 00:01:02.594978 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-AttachVolumeTestJSON-1068932957 Sep 13 00:01:02.594978 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant-Id: ffc5ce52ae574b82bda143e766bcec80 Sep 13 00:01:02.594978 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1068932957 Sep 13 00:01:02.594978 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User: tempest-AttachVolumeTestJSON-1068932957-project Sep 13 00:01:02.594978 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Sep 13 00:01:02.594978 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Sep 13 00:01:02.594978 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Id: 0d81b048f7e64c53894ad9e9ee33f518 Sep 13 00:01:02.594978 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-AttachVolumeTestJSON-1068932957-project Sep 13 00:01:02.594978 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: method: > Sep 13 00:01:02.594978 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: exception: Instance df2886ea-3e42-4713-82e6-bacd4de26d8c could not be found. Sep 13 00:01:02.594978 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: action_args: {'id': 'df2886ea-3e42-4713-82e6-bacd4de26d8c'} Sep 13 00:01:02.596707 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 00:01:02.596707 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:01:02.596707 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 00:01:02.596707 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 00:01:02.596707 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 00:01:02.596707 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 00:01:02.596707 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 00:01:02.596707 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 00:01:02.596707 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 00:01:02.596707 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 00:01:02.596707 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df2886ea-3e42-4713-82e6-bacd4de26d8c could not be found. Sep 13 00:01:02.596707 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:01:02.596707 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 00:01:02.596707 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:01:02.596707 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:01:02.596707 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 00:01:02.596707 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 00:01:02.596707 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 00:01:02.596707 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 00:01:02.596707 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 00:01:02.599267 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 00:01:02.599267 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 00:01:02.599267 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 00:01:02.599267 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 00:01:02.599267 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 00:01:02.599267 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 00:01:02.599267 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 00:01:02.599267 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 00:01:02.599267 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 00:01:02.599267 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df2886ea-3e42-4713-82e6-bacd4de26d8c could not be found. Sep 13 00:01:02.599267 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:01:02.599267 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 00:01:02.599267 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:01:02.599267 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:01:02.599267 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 00:01:02.599267 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 00:01:02.599267 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 00:01:02.599267 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 00:01:02.599267 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df2886ea-3e42-4713-82e6-bacd4de26d8c could not be found. Sep 13 00:01:02.599267 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:01:02.601582 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-de51ab27-4137-496f-b27c-79a481214e3f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Returning 404 to user: Instance df2886ea-3e42-4713-82e6-bacd4de26d8c could not be found. {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 00:01:02.601582 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-de51ab27-4137-496f-b27c-79a481214e3f tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "DELETE /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c" status: 404 len: 111 microversion: 2.1 time: 0.032695 Sep 13 00:01:02.601582 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 407/818] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Sep 13 00:01:02 2022] DELETE /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 00:01:02.603596 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1950b76c-21ce-49d5-96fe-f920e1356356 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:01:02.604275 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1950b76c-21ce-49d5-96fe-f920e1356356 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] [instance: df2886ea-3e42-4713-82e6-bacd4de26d8c] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:01:02.611719 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1950b76c-21ce-49d5-96fe-f920e1356356 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:01:02.612213 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1950b76c-21ce-49d5-96fe-f920e1356356 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:01:02.613766 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1950b76c-21ce-49d5-96fe-f920e1356356 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:01:02.613766 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1950b76c-21ce-49d5-96fe-f920e1356356 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:01:02.614010 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1950b76c-21ce-49d5-96fe-f920e1356356 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:01:02.614309 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-1950b76c-21ce-49d5-96fe-f920e1356356 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:01:02.632358 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-1950b76c-21ce-49d5-96fe-f920e1356356 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] HTTP exception thrown: Instance df2886ea-3e42-4713-82e6-bacd4de26d8c could not be found. Sep 13 00:01:02.634276 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1950b76c-21ce-49d5-96fe-f920e1356356 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Request method failure captured: Sep 13 00:01:02.634276 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: request: GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c HTTP/1.1 Sep 13 00:01:02.634276 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept: application/json Sep 13 00:01:02.634276 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Sep 13 00:01:02.634276 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Connection: close Sep 13 00:01:02.634276 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Length: 0 Sep 13 00:01:02.634276 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Type: application/json Sep 13 00:01:02.634276 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Host: 10.222.0.26 Sep 13 00:01:02.634276 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Sep 13 00:01:02.634276 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Sep 13 00:01:02.634276 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjH8bc4bJdVDTQjQ-S_BrNKXiAQaJrogJrt6IBcOL1djQpAvT8zwXOYVZlnrngFM7OG_4Ir8seGcj-mSqgkiw6n-dR85_T4cZlf5h7G8ApBZL33D25KZPqSRXq1fcMYh9s_4RqV8zn646ssP0OB_eBcWsbUyrEYN7lSok4iWBOPJYkWAE Sep 13 00:01:02.634276 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Sep 13 00:01:02.634276 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Sep 13 00:01:02.634276 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Sep 13 00:01:02.634276 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Sep 13 00:01:02.634276 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Sep 13 00:01:02.634276 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Sep 13 00:01:02.634276 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Id: ffc5ce52ae574b82bda143e766bcec80 Sep 13 00:01:02.634276 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-AttachVolumeTestJSON-1068932957 Sep 13 00:01:02.634276 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Role: member,reader Sep 13 00:01:02.634276 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Roles: member,reader Sep 13 00:01:02.637435 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ffc5ce52ae574b82bda143e766bcec80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ffc5ce52ae574b82bda143e766bcec80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ffc5ce52ae574b82bda143e766bcec80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ffc5ce52ae574b82bda143e766bcec80"}]}] Sep 13 00:01:02.637435 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-AttachVolumeTestJSON-1068932957 Sep 13 00:01:02.637435 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Id: ffc5ce52ae574b82bda143e766bcec80 Sep 13 00:01:02.637435 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1068932957 Sep 13 00:01:02.637435 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User: tempest-AttachVolumeTestJSON-1068932957-project Sep 13 00:01:02.637435 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Sep 13 00:01:02.637435 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Sep 13 00:01:02.637435 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Id: 0d81b048f7e64c53894ad9e9ee33f518 Sep 13 00:01:02.637435 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-AttachVolumeTestJSON-1068932957-project Sep 13 00:01:02.637435 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: method: > Sep 13 00:01:02.637435 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: exception: Instance df2886ea-3e42-4713-82e6-bacd4de26d8c could not be found. Sep 13 00:01:02.637435 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: action_args: {'id': 'df2886ea-3e42-4713-82e6-bacd4de26d8c'} Sep 13 00:01:02.639310 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 00:01:02.639310 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:01:02.639310 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 00:01:02.639310 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 00:01:02.639310 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 00:01:02.639310 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 00:01:02.639310 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 00:01:02.639310 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 00:01:02.639310 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 00:01:02.639310 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 00:01:02.639310 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df2886ea-3e42-4713-82e6-bacd4de26d8c could not be found. Sep 13 00:01:02.639310 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:01:02.639310 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 00:01:02.639310 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:01:02.639310 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:01:02.639310 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 00:01:02.639310 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 00:01:02.639310 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 00:01:02.639310 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 00:01:02.639310 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 00:01:02.642267 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 00:01:02.642267 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 00:01:02.642267 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 00:01:02.642267 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 00:01:02.642267 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 00:01:02.642267 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 00:01:02.642267 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 00:01:02.642267 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df2886ea-3e42-4713-82e6-bacd4de26d8c could not be found. Sep 13 00:01:02.642267 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:01:02.642267 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 00:01:02.642267 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:01:02.642267 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:01:02.642267 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 00:01:02.642267 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 00:01:02.642267 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 00:01:02.642267 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 00:01:02.642267 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df2886ea-3e42-4713-82e6-bacd4de26d8c could not be found. Sep 13 00:01:02.642267 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:01:02.644827 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1950b76c-21ce-49d5-96fe-f920e1356356 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] Returning 404 to user: Instance df2886ea-3e42-4713-82e6-bacd4de26d8c could not be found. {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 00:01:02.644827 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1950b76c-21ce-49d5-96fe-f920e1356356 tempest-AttachVolumeTestJSON-1068932957 tempest-AttachVolumeTestJSON-1068932957-project] 10.222.0.26 "GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c" status: 404 len: 111 microversion: 2.1 time: 0.036408 Sep 13 00:01:02.644827 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 412/819] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:01:02 2022] GET /compute/v2.1/servers/df2886ea-3e42-4713-82e6-bacd4de26d8c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 00:01:08.552288 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3f513eb1-dc55-475a-8f9f-b0541f2ba3ab tempest-VolumesSnapshotsTestJSON-162998172 tempest-VolumesSnapshotsTestJSON-162998172-project] Action: 'create', calling method: .version_select at 0x7fed011cc280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-144195503"}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 00:01:08.925613 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3f513eb1-dc55-475a-8f9f-b0541f2ba3ab tempest-VolumesSnapshotsTestJSON-162998172 tempest-VolumesSnapshotsTestJSON-162998172-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.556209 Sep 13 00:01:08.926249 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 408/820] 10.222.0.26 () {60 vars in 1155 bytes} [Tue Sep 13 00:01:08 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 558 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 13 00:01:08.939355 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a7385c1a-bf06-4a9f-b392-097a0d31cc7b tempest-VolumesSnapshotsTestJSON-162998172 tempest-VolumesSnapshotsTestJSON-162998172-project] Calling method '.version_select at 0x7fed012de160>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:01:08.990940 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a7385c1a-bf06-4a9f-b392-097a0d31cc7b tempest-VolumesSnapshotsTestJSON-162998172 tempest-VolumesSnapshotsTestJSON-162998172-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/770bbbe7-9012-4169-a3b7-e6fb442aad93" status: 200 len: 344 microversion: 2.1 time: 0.055514 Sep 13 00:01:08.991562 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 413/821] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Sep 13 00:01:08 2022] GET /compute/v2.1/os-volumes/770bbbe7-9012-4169-a3b7-e6fb442aad93 => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 00:01:10.007920 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-167d9d40-4ec9-435f-ae3e-13d470e019c4 tempest-VolumesSnapshotsTestJSON-162998172 tempest-VolumesSnapshotsTestJSON-162998172-project] Calling method '.version_select at 0x7fed0129c160>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:01:10.074615 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-167d9d40-4ec9-435f-ae3e-13d470e019c4 tempest-VolumesSnapshotsTestJSON-162998172 tempest-VolumesSnapshotsTestJSON-162998172-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/770bbbe7-9012-4169-a3b7-e6fb442aad93" status: 200 len: 345 microversion: 2.1 time: 0.071514 Sep 13 00:01:10.075205 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 409/822] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Sep 13 00:01:10 2022] GET /compute/v2.1/os-volumes/770bbbe7-9012-4169-a3b7-e6fb442aad93 => generated 345 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 00:01:10.090928 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2ee9a97a-4909-4627-ac46-3c714d1bcf6b tempest-VolumesSnapshotsTestJSON-162998172 tempest-VolumesSnapshotsTestJSON-162998172-project] Action: 'create', calling method: .version_select at 0x7fed012ca700>, body: {"snapshot": {"volume_id": "770bbbe7-9012-4169-a3b7-e6fb442aad93", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1278479592"}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 00:01:10.287480 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2ee9a97a-4909-4627-ac46-3c714d1bcf6b tempest-VolumesSnapshotsTestJSON-162998172 tempest-VolumesSnapshotsTestJSON-162998172-project] 10.222.0.26 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.201609 Sep 13 00:01:10.294106 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 414/823] 10.222.0.26 () {60 vars in 1162 bytes} [Tue Sep 13 00:01:10 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 00:01:10.302674 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-44f10e71-107e-4048-ab7b-2e19158c495c tempest-VolumesSnapshotsTestJSON-162998172 tempest-VolumesSnapshotsTestJSON-162998172-project] Calling method '.version_select at 0x7fed0140c670>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:01:10.349500 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-44f10e71-107e-4048-ab7b-2e19158c495c tempest-VolumesSnapshotsTestJSON-162998172 tempest-VolumesSnapshotsTestJSON-162998172-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/967bd2a6-1696-44be-89ad-16f6d730a4dc" status: 200 len: 287 microversion: 2.1 time: 0.053213 Sep 13 00:01:10.350212 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 410/824] 10.222.0.26 () {58 vars in 1251 bytes} [Tue Sep 13 00:01:10 2022] GET /compute/v2.1/os-snapshots/967bd2a6-1696-44be-89ad-16f6d730a4dc => generated 287 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 00:01:10.362608 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-955df819-6ea7-4184-bb5e-9607598506b1 tempest-VolumesSnapshotsTestJSON-162998172 tempest-VolumesSnapshotsTestJSON-162998172-project] Calling method '.version_select at 0x7fed012ca160>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:01:10.404044 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-955df819-6ea7-4184-bb5e-9607598506b1 tempest-VolumesSnapshotsTestJSON-162998172 tempest-VolumesSnapshotsTestJSON-162998172-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.045799 Sep 13 00:01:10.404938 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 415/825] 10.222.0.26 () {58 vars in 1140 bytes} [Tue Sep 13 00:01:10 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 00:01:10.419406 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1bbf6cde-25a2-404f-a7eb-6e3859641ef4 tempest-VolumesSnapshotsTestJSON-162998172 tempest-VolumesSnapshotsTestJSON-162998172-project] Calling method '.version_select at 0x7fed011cc310>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:01:10.455249 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1bbf6cde-25a2-404f-a7eb-6e3859641ef4 tempest-VolumesSnapshotsTestJSON-162998172 tempest-VolumesSnapshotsTestJSON-162998172-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/967bd2a6-1696-44be-89ad-16f6d730a4dc" status: 200 len: 287 microversion: 2.1 time: 0.041523 Sep 13 00:01:10.455916 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 411/826] 10.222.0.26 () {58 vars in 1251 bytes} [Tue Sep 13 00:01:10 2022] GET /compute/v2.1/os-snapshots/967bd2a6-1696-44be-89ad-16f6d730a4dc => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 00:01:11.469714 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-04861694-d73b-4715-97d0-2d5db1bbfa2f tempest-VolumesSnapshotsTestJSON-162998172 tempest-VolumesSnapshotsTestJSON-162998172-project] Calling method '.version_select at 0x7fed01557f70>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:01:11.501106 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-04861694-d73b-4715-97d0-2d5db1bbfa2f tempest-VolumesSnapshotsTestJSON-162998172 tempest-VolumesSnapshotsTestJSON-162998172-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/967bd2a6-1696-44be-89ad-16f6d730a4dc" status: 200 len: 287 microversion: 2.1 time: 0.035795 Sep 13 00:01:11.501672 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 416/827] 10.222.0.26 () {58 vars in 1251 bytes} [Tue Sep 13 00:01:11 2022] GET /compute/v2.1/os-snapshots/967bd2a6-1696-44be-89ad-16f6d730a4dc => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 00:01:12.517489 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-db73a081-9c14-4416-a083-cfb7f66fad6c tempest-VolumesSnapshotsTestJSON-162998172 tempest-VolumesSnapshotsTestJSON-162998172-project] Calling method '.version_select at 0x7fed012f6940>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:01:12.548674 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-db73a081-9c14-4416-a083-cfb7f66fad6c tempest-VolumesSnapshotsTestJSON-162998172 tempest-VolumesSnapshotsTestJSON-162998172-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/967bd2a6-1696-44be-89ad-16f6d730a4dc" status: 200 len: 287 microversion: 2.1 time: 0.037777 Sep 13 00:01:12.549216 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 412/828] 10.222.0.26 () {58 vars in 1251 bytes} [Tue Sep 13 00:01:12 2022] GET /compute/v2.1/os-snapshots/967bd2a6-1696-44be-89ad-16f6d730a4dc => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 00:01:13.560527 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:01:13.561131 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=44,nova_cell1:INSERT=1 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:01:13.566151 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e14caee2-71c0-4b34-9901-a851657c1ccd tempest-VolumesSnapshotsTestJSON-162998172 tempest-VolumesSnapshotsTestJSON-162998172-project] Calling method '.version_select at 0x7fed01291dc0>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:01:13.601639 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e14caee2-71c0-4b34-9901-a851657c1ccd tempest-VolumesSnapshotsTestJSON-162998172 tempest-VolumesSnapshotsTestJSON-162998172-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/967bd2a6-1696-44be-89ad-16f6d730a4dc" status: 200 len: 288 microversion: 2.1 time: 0.043173 Sep 13 00:01:13.602219 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 417/829] 10.222.0.26 () {58 vars in 1251 bytes} [Tue Sep 13 00:01:13 2022] GET /compute/v2.1/os-snapshots/967bd2a6-1696-44be-89ad-16f6d730a4dc => generated 288 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 00:01:13.610992 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:01:13.611788 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:01:13.616591 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-20680635-fabd-4c0e-8c72-6c476b291a38 tempest-VolumesSnapshotsTestJSON-162998172 tempest-VolumesSnapshotsTestJSON-162998172-project] Calling method '.version_select at 0x7fed012d9b80>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:01:13.678810 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-20680635-fabd-4c0e-8c72-6c476b291a38 tempest-VolumesSnapshotsTestJSON-162998172 tempest-VolumesSnapshotsTestJSON-162998172-project] 10.222.0.26 "DELETE /compute/v2.1/os-snapshots/967bd2a6-1696-44be-89ad-16f6d730a4dc" status: 202 len: 0 microversion: 2.1 time: 0.068739 Sep 13 00:01:13.679457 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 413/830] 10.222.0.26 () {58 vars in 1254 bytes} [Tue Sep 13 00:01:13 2022] DELETE /compute/v2.1/os-snapshots/967bd2a6-1696-44be-89ad-16f6d730a4dc => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 00:01:13.690618 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f20a4463-a8e1-4010-b32d-a82221d2402b tempest-VolumesSnapshotsTestJSON-162998172 tempest-VolumesSnapshotsTestJSON-162998172-project] Calling method '.version_select at 0x7fed01287160>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:01:13.725342 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f20a4463-a8e1-4010-b32d-a82221d2402b tempest-VolumesSnapshotsTestJSON-162998172 tempest-VolumesSnapshotsTestJSON-162998172-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/967bd2a6-1696-44be-89ad-16f6d730a4dc" status: 200 len: 287 microversion: 2.1 time: 0.040495 Sep 13 00:01:13.726043 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 418/831] 10.222.0.26 () {58 vars in 1251 bytes} [Tue Sep 13 00:01:13 2022] GET /compute/v2.1/os-snapshots/967bd2a6-1696-44be-89ad-16f6d730a4dc => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 00:01:14.740488 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-70cf0911-7748-45b4-ab54-cd99f6761ddf tempest-VolumesSnapshotsTestJSON-162998172 tempest-VolumesSnapshotsTestJSON-162998172-project] Calling method '.version_select at 0x7fed012f6b80>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:01:14.774098 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-70cf0911-7748-45b4-ab54-cd99f6761ddf tempest-VolumesSnapshotsTestJSON-162998172 tempest-VolumesSnapshotsTestJSON-162998172-project] HTTP exception thrown: Snapshot 967bd2a6-1696-44be-89ad-16f6d730a4dc could not be found. Sep 13 00:01:14.778114 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-70cf0911-7748-45b4-ab54-cd99f6761ddf tempest-VolumesSnapshotsTestJSON-162998172 tempest-VolumesSnapshotsTestJSON-162998172-project] Request method failure captured: Sep 13 00:01:14.778114 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: request: GET /compute/v2.1/os-snapshots/967bd2a6-1696-44be-89ad-16f6d730a4dc HTTP/1.1 Sep 13 00:01:14.778114 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Accept: application/json Sep 13 00:01:14.778114 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Sep 13 00:01:14.778114 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Connection: close Sep 13 00:01:14.778114 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Content-Length: 0 Sep 13 00:01:14.778114 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Content-Type: application/json Sep 13 00:01:14.778114 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Host: 10.222.0.26 Sep 13 00:01:14.778114 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Sep 13 00:01:14.778114 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Sep 13 00:01:14.778114 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjH8hE4alJjRwbIR9yJA0TKf2fPLfJDI5bYgTtbk8etZUm3my8tCVqpV7nSKeVRc7_BQiuOi2VWr3dgXg4M6IB4kcvOxSTXOcWLMsp8cB11RNZOCL8mDxqtQ44f7VsR45zUo6IWdMbF7r6MX-n145rFdzyOcBFYzyEGiVUxKqbNeDcm7s Sep 13 00:01:14.778114 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Sep 13 00:01:14.778114 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Sep 13 00:01:14.778114 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Sep 13 00:01:14.778114 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Sep 13 00:01:14.778114 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Sep 13 00:01:14.778114 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Sep 13 00:01:14.778114 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Id: 8f0e75134c574437943e4e551b4f0883 Sep 13 00:01:14.778114 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-162998172 Sep 13 00:01:14.778114 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Role: member,reader Sep 13 00:01:14.778114 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Roles: member,reader Sep 13 00:01:14.779833 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8f0e75134c574437943e4e551b4f0883"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8f0e75134c574437943e4e551b4f0883"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8f0e75134c574437943e4e551b4f0883"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8f0e75134c574437943e4e551b4f0883"}]}] Sep 13 00:01:14.779833 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-VolumesSnapshotsTestJSON-162998172 Sep 13 00:01:14.779833 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant-Id: 8f0e75134c574437943e4e551b4f0883 Sep 13 00:01:14.779833 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-162998172 Sep 13 00:01:14.779833 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User: tempest-VolumesSnapshotsTestJSON-162998172-project Sep 13 00:01:14.779833 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Sep 13 00:01:14.779833 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Sep 13 00:01:14.779833 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Id: 8f4781b08fec4b43bd28b7a8396ddb45 Sep 13 00:01:14.779833 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-VolumesSnapshotsTestJSON-162998172-project Sep 13 00:01:14.779833 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: method: Sep 13 00:01:14.779833 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: exception: Snapshot 967bd2a6-1696-44be-89ad-16f6d730a4dc could not be found. Sep 13 00:01:14.779833 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: action_args: {'id': '967bd2a6-1696-44be-89ad-16f6d730a4dc'} Sep 13 00:01:14.779833 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 00:01:14.780772 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:01:14.780772 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 13 00:01:14.780772 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 13 00:01:14.780772 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 13 00:01:14.780772 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 13 00:01:14.780772 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 13 00:01:14.780772 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 13 00:01:14.780772 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 00:01:14.780772 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 00:01:14.780772 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 00:01:14.780772 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 00:01:14.780772 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 00:01:14.780772 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 00:01:14.780772 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 00:01:14.780772 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 00:01:14.780772 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 967bd2a6-1696-44be-89ad-16f6d730a4dc could not be found. (HTTP 404) (Request-ID: req-a0d12bc0-1abb-4b97-9cdc-968d2d3cdb39) Sep 13 00:01:14.780772 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:01:14.780772 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 00:01:14.782282 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:01:14.782282 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:01:14.782282 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 13 00:01:14.782282 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 13 00:01:14.782282 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 00:01:14.782282 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 00:01:14.782282 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 13 00:01:14.782282 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 13 00:01:14.782282 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 00:01:14.782282 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 00:01:14.782282 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 13 00:01:14.782282 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 13 00:01:14.782282 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 13 00:01:14.782282 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 13 00:01:14.782282 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 13 00:01:14.782282 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 13 00:01:14.782282 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 00:01:14.782282 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 00:01:14.782282 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 00:01:14.783746 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 00:01:14.783746 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 00:01:14.783746 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 00:01:14.783746 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 00:01:14.783746 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 00:01:14.783746 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 967bd2a6-1696-44be-89ad-16f6d730a4dc could not be found. Sep 13 00:01:14.783746 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:01:14.783746 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 00:01:14.783746 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:01:14.783746 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:01:14.783746 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 00:01:14.783746 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 00:01:14.783746 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 00:01:14.783746 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 00:01:14.783746 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 00:01:14.783746 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 00:01:14.783746 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 00:01:14.783746 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 00:01:14.783746 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 13 00:01:14.783746 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 00:01:14.785178 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 967bd2a6-1696-44be-89ad-16f6d730a4dc could not be found. Sep 13 00:01:14.785178 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:01:14.785178 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 00:01:14.785178 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:01:14.785178 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:01:14.785178 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 00:01:14.785178 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 00:01:14.785178 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 00:01:14.785178 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 00:01:14.785178 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 967bd2a6-1696-44be-89ad-16f6d730a4dc could not be found. Sep 13 00:01:14.785178 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:01:14.785178 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-70cf0911-7748-45b4-ab54-cd99f6761ddf tempest-VolumesSnapshotsTestJSON-162998172 tempest-VolumesSnapshotsTestJSON-162998172-project] Returning 404 to user: Snapshot 967bd2a6-1696-44be-89ad-16f6d730a4dc could not be found. {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 00:01:14.785178 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-70cf0911-7748-45b4-ab54-cd99f6761ddf tempest-VolumesSnapshotsTestJSON-162998172 tempest-VolumesSnapshotsTestJSON-162998172-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/967bd2a6-1696-44be-89ad-16f6d730a4dc" status: 404 len: 111 microversion: 2.1 time: 0.045479 Sep 13 00:01:14.785178 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 414/832] 10.222.0.26 () {58 vars in 1251 bytes} [Tue Sep 13 00:01:14 2022] GET /compute/v2.1/os-snapshots/967bd2a6-1696-44be-89ad-16f6d730a4dc => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 00:01:14.790023 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a2f98b3c-ad34-423f-a957-455cd3551864 tempest-VolumesSnapshotsTestJSON-162998172 tempest-VolumesSnapshotsTestJSON-162998172-project] Calling method '.version_select at 0x7fed01313dc0>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:01:14.891172 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a2f98b3c-ad34-423f-a957-455cd3551864 tempest-VolumesSnapshotsTestJSON-162998172 tempest-VolumesSnapshotsTestJSON-162998172-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/770bbbe7-9012-4169-a3b7-e6fb442aad93" status: 202 len: 0 microversion: 2.1 time: 0.102802 Sep 13 00:01:14.891172 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 419/833] 10.222.0.26 () {58 vars in 1248 bytes} [Tue Sep 13 00:01:14 2022] DELETE /compute/v2.1/os-volumes/770bbbe7-9012-4169-a3b7-e6fb442aad93 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 00:01:14.901373 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-76544644-2506-4498-ae5c-0fd6e8f61c96 tempest-VolumesSnapshotsTestJSON-162998172 tempest-VolumesSnapshotsTestJSON-162998172-project] Calling method '.version_select at 0x7fed0120c3a0>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:01:14.977676 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-76544644-2506-4498-ae5c-0fd6e8f61c96 tempest-VolumesSnapshotsTestJSON-162998172 tempest-VolumesSnapshotsTestJSON-162998172-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/770bbbe7-9012-4169-a3b7-e6fb442aad93" status: 200 len: 344 microversion: 2.1 time: 0.083190 Sep 13 00:01:14.979661 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 415/834] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Sep 13 00:01:14 2022] GET /compute/v2.1/os-volumes/770bbbe7-9012-4169-a3b7-e6fb442aad93 => generated 344 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 00:01:15.994265 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-07480fea-fd90-4636-90a5-69c9a504d137 tempest-VolumesSnapshotsTestJSON-162998172 tempest-VolumesSnapshotsTestJSON-162998172-project] Calling method '.version_select at 0x7fed0129b940>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:01:16.043132 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-07480fea-fd90-4636-90a5-69c9a504d137 tempest-VolumesSnapshotsTestJSON-162998172 tempest-VolumesSnapshotsTestJSON-162998172-project] HTTP exception thrown: Volume 770bbbe7-9012-4169-a3b7-e6fb442aad93 could not be found. Sep 13 00:01:16.047694 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-07480fea-fd90-4636-90a5-69c9a504d137 tempest-VolumesSnapshotsTestJSON-162998172 tempest-VolumesSnapshotsTestJSON-162998172-project] Request method failure captured: Sep 13 00:01:16.047694 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: request: GET /compute/v2.1/os-volumes/770bbbe7-9012-4169-a3b7-e6fb442aad93 HTTP/1.1 Sep 13 00:01:16.047694 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept: application/json Sep 13 00:01:16.047694 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Sep 13 00:01:16.047694 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Connection: close Sep 13 00:01:16.047694 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Length: 0 Sep 13 00:01:16.047694 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Type: application/json Sep 13 00:01:16.047694 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Host: 10.222.0.26 Sep 13 00:01:16.047694 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Sep 13 00:01:16.047694 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Sep 13 00:01:16.047694 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjH8hE4alJjRwbIR9yJA0TKf2fPLfJDI5bYgTtbk8etZUm3my8tCVqpV7nSKeVRc7_BQiuOi2VWr3dgXg4M6IB4kcvOxSTXOcWLMsp8cB11RNZOCL8mDxqtQ44f7VsR45zUo6IWdMbF7r6MX-n145rFdzyOcBFYzyEGiVUxKqbNeDcm7s Sep 13 00:01:16.047694 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Sep 13 00:01:16.047694 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Sep 13 00:01:16.047694 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Sep 13 00:01:16.047694 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Sep 13 00:01:16.047694 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Sep 13 00:01:16.047694 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Sep 13 00:01:16.047694 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Id: 8f0e75134c574437943e4e551b4f0883 Sep 13 00:01:16.047694 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-162998172 Sep 13 00:01:16.047694 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Role: member,reader Sep 13 00:01:16.047694 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Roles: member,reader Sep 13 00:01:16.049360 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8f0e75134c574437943e4e551b4f0883"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8f0e75134c574437943e4e551b4f0883"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8f0e75134c574437943e4e551b4f0883"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8f0e75134c574437943e4e551b4f0883"}]}] Sep 13 00:01:16.049360 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-VolumesSnapshotsTestJSON-162998172 Sep 13 00:01:16.049360 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Id: 8f0e75134c574437943e4e551b4f0883 Sep 13 00:01:16.049360 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-162998172 Sep 13 00:01:16.049360 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User: tempest-VolumesSnapshotsTestJSON-162998172-project Sep 13 00:01:16.049360 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Sep 13 00:01:16.049360 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Sep 13 00:01:16.049360 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Id: 8f4781b08fec4b43bd28b7a8396ddb45 Sep 13 00:01:16.049360 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-VolumesSnapshotsTestJSON-162998172-project Sep 13 00:01:16.049360 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: method: Sep 13 00:01:16.049360 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: exception: Volume 770bbbe7-9012-4169-a3b7-e6fb442aad93 could not be found. Sep 13 00:01:16.049360 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: action_args: {'id': '770bbbe7-9012-4169-a3b7-e6fb442aad93'} Sep 13 00:01:16.049360 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 00:01:16.050291 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:01:16.050291 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 00:01:16.050291 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 00:01:16.050291 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 00:01:16.050291 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 00:01:16.050291 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 00:01:16.050291 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 00:01:16.050291 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 00:01:16.050291 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 00:01:16.050291 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 00:01:16.050291 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 00:01:16.050291 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 00:01:16.050291 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 00:01:16.050291 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 00:01:16.050291 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 00:01:16.050291 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 770bbbe7-9012-4169-a3b7-e6fb442aad93 could not be found. (HTTP 404) (Request-ID: req-79dc1ee9-b219-4a0a-a0c2-9f0e70f7ec56) Sep 13 00:01:16.050291 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:01:16.050291 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 00:01:16.050291 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:01:16.051679 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:01:16.051679 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 00:01:16.051679 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 00:01:16.051679 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 00:01:16.051679 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 00:01:16.051679 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 00:01:16.051679 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 00:01:16.051679 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 00:01:16.051679 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 00:01:16.051679 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 00:01:16.051679 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 00:01:16.051679 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 00:01:16.051679 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 00:01:16.051679 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 00:01:16.051679 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 00:01:16.051679 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 00:01:16.051679 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 00:01:16.051679 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 00:01:16.051679 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 00:01:16.053418 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 00:01:16.053418 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 00:01:16.053418 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 00:01:16.053418 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 00:01:16.053418 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 770bbbe7-9012-4169-a3b7-e6fb442aad93 could not be found. Sep 13 00:01:16.053418 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:01:16.053418 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 00:01:16.053418 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:01:16.053418 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:01:16.053418 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 00:01:16.053418 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 00:01:16.053418 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 00:01:16.053418 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 00:01:16.053418 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 00:01:16.053418 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 00:01:16.053418 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 00:01:16.053418 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 00:01:16.053418 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 00:01:16.053418 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 00:01:16.055307 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 770bbbe7-9012-4169-a3b7-e6fb442aad93 could not be found. Sep 13 00:01:16.055307 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:01:16.055307 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 00:01:16.055307 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:01:16.055307 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:01:16.055307 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 00:01:16.055307 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 00:01:16.055307 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 00:01:16.055307 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 00:01:16.055307 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 770bbbe7-9012-4169-a3b7-e6fb442aad93 could not be found. Sep 13 00:01:16.055307 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:01:16.055307 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-07480fea-fd90-4636-90a5-69c9a504d137 tempest-VolumesSnapshotsTestJSON-162998172 tempest-VolumesSnapshotsTestJSON-162998172-project] Returning 404 to user: Volume 770bbbe7-9012-4169-a3b7-e6fb442aad93 could not be found. {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 00:01:16.055307 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-07480fea-fd90-4636-90a5-69c9a504d137 tempest-VolumesSnapshotsTestJSON-162998172 tempest-VolumesSnapshotsTestJSON-162998172-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/770bbbe7-9012-4169-a3b7-e6fb442aad93" status: 404 len: 109 microversion: 2.1 time: 0.060535 Sep 13 00:01:16.055307 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 420/835] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Sep 13 00:01:15 2022] GET /compute/v2.1/os-volumes/770bbbe7-9012-4169-a3b7-e6fb442aad93 => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 00:01:16.081303 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-bb4650fa-a05d-45ba-84de-1d7db2e31f36 tempest-VolumesSnapshotsTestJSON-162998172 tempest-VolumesSnapshotsTestJSON-162998172-project] Calling method '.version_select at 0x7fed0144bc10>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:01:16.113429 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-bb4650fa-a05d-45ba-84de-1d7db2e31f36 tempest-VolumesSnapshotsTestJSON-162998172 tempest-VolumesSnapshotsTestJSON-162998172-project] HTTP exception thrown: Volume 770bbbe7-9012-4169-a3b7-e6fb442aad93 could not be found. Sep 13 00:01:16.117563 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-bb4650fa-a05d-45ba-84de-1d7db2e31f36 tempest-VolumesSnapshotsTestJSON-162998172 tempest-VolumesSnapshotsTestJSON-162998172-project] Request method failure captured: Sep 13 00:01:16.117563 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: request: DELETE /compute/v2.1/os-volumes/770bbbe7-9012-4169-a3b7-e6fb442aad93 HTTP/1.1 Sep 13 00:01:16.117563 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Accept: application/json Sep 13 00:01:16.117563 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Sep 13 00:01:16.117563 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Connection: close Sep 13 00:01:16.117563 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Content-Length: 0 Sep 13 00:01:16.117563 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Content-Type: application/json Sep 13 00:01:16.117563 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Host: 10.222.0.26 Sep 13 00:01:16.117563 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Sep 13 00:01:16.117563 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Sep 13 00:01:16.117563 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjH8hE4alJjRwbIR9yJA0TKf2fPLfJDI5bYgTtbk8etZUm3my8tCVqpV7nSKeVRc7_BQiuOi2VWr3dgXg4M6IB4kcvOxSTXOcWLMsp8cB11RNZOCL8mDxqtQ44f7VsR45zUo6IWdMbF7r6MX-n145rFdzyOcBFYzyEGiVUxKqbNeDcm7s Sep 13 00:01:16.117563 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Sep 13 00:01:16.117563 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Sep 13 00:01:16.117563 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Sep 13 00:01:16.117563 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Sep 13 00:01:16.117563 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Sep 13 00:01:16.117563 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Sep 13 00:01:16.117563 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Id: 8f0e75134c574437943e4e551b4f0883 Sep 13 00:01:16.117563 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-162998172 Sep 13 00:01:16.117563 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Role: member,reader Sep 13 00:01:16.117563 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Roles: member,reader Sep 13 00:01:16.119102 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8f0e75134c574437943e4e551b4f0883"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8f0e75134c574437943e4e551b4f0883"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8f0e75134c574437943e4e551b4f0883"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8f0e75134c574437943e4e551b4f0883"}]}] Sep 13 00:01:16.119102 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-VolumesSnapshotsTestJSON-162998172 Sep 13 00:01:16.119102 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant-Id: 8f0e75134c574437943e4e551b4f0883 Sep 13 00:01:16.119102 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-162998172 Sep 13 00:01:16.119102 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User: tempest-VolumesSnapshotsTestJSON-162998172-project Sep 13 00:01:16.119102 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Sep 13 00:01:16.119102 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Sep 13 00:01:16.119102 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Id: 8f4781b08fec4b43bd28b7a8396ddb45 Sep 13 00:01:16.119102 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-VolumesSnapshotsTestJSON-162998172-project Sep 13 00:01:16.119102 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: method: Sep 13 00:01:16.119102 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: exception: Volume 770bbbe7-9012-4169-a3b7-e6fb442aad93 could not be found. Sep 13 00:01:16.119102 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: action_args: {'id': '770bbbe7-9012-4169-a3b7-e6fb442aad93'} Sep 13 00:01:16.119102 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 00:01:16.123832 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:01:16.123832 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 00:01:16.123832 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 00:01:16.123832 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 00:01:16.123832 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 00:01:16.123832 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 00:01:16.123832 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 00:01:16.123832 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 00:01:16.123832 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 00:01:16.123832 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 00:01:16.123832 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 00:01:16.123832 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 00:01:16.123832 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 00:01:16.123832 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 00:01:16.123832 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 00:01:16.123832 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 770bbbe7-9012-4169-a3b7-e6fb442aad93 could not be found. (HTTP 404) (Request-ID: req-3615cbce-dff3-4e23-9576-b7e0f297c88f) Sep 13 00:01:16.123832 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:01:16.123832 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 00:01:16.123832 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:01:16.125019 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:01:16.125019 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 13 00:01:16.125019 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 13 00:01:16.125019 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 00:01:16.125019 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 00:01:16.125019 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 00:01:16.125019 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 00:01:16.125019 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 00:01:16.125019 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 00:01:16.125019 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 00:01:16.125019 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 00:01:16.125019 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 00:01:16.125019 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 00:01:16.125019 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 00:01:16.125019 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 00:01:16.125019 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 00:01:16.125019 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 00:01:16.125019 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 00:01:16.125019 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 00:01:16.126233 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 00:01:16.126233 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 00:01:16.126233 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 00:01:16.126233 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 00:01:16.126233 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 770bbbe7-9012-4169-a3b7-e6fb442aad93 could not be found. Sep 13 00:01:16.126233 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:01:16.126233 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 00:01:16.126233 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:01:16.126233 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:01:16.126233 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 00:01:16.126233 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 00:01:16.126233 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 00:01:16.126233 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 00:01:16.126233 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 00:01:16.126233 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 00:01:16.126233 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 00:01:16.126233 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 00:01:16.126233 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 13 00:01:16.126233 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 00:01:16.127477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 770bbbe7-9012-4169-a3b7-e6fb442aad93 could not be found. Sep 13 00:01:16.127477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:01:16.127477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 00:01:16.127477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:01:16.127477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:01:16.127477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 00:01:16.127477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 00:01:16.127477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 00:01:16.127477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 00:01:16.127477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 770bbbe7-9012-4169-a3b7-e6fb442aad93 could not be found. Sep 13 00:01:16.127477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:01:16.127477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-bb4650fa-a05d-45ba-84de-1d7db2e31f36 tempest-VolumesSnapshotsTestJSON-162998172 tempest-VolumesSnapshotsTestJSON-162998172-project] Returning 404 to user: Volume 770bbbe7-9012-4169-a3b7-e6fb442aad93 could not be found. {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 00:01:16.127477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-bb4650fa-a05d-45ba-84de-1d7db2e31f36 tempest-VolumesSnapshotsTestJSON-162998172 tempest-VolumesSnapshotsTestJSON-162998172-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/770bbbe7-9012-4169-a3b7-e6fb442aad93" status: 404 len: 109 microversion: 2.1 time: 0.044153 Sep 13 00:01:16.127477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 416/836] 10.222.0.26 () {58 vars in 1248 bytes} [Tue Sep 13 00:01:16 2022] DELETE /compute/v2.1/os-volumes/770bbbe7-9012-4169-a3b7-e6fb442aad93 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 00:01:16.134043 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ed062e84-a326-4892-9448-59293b4f5dcb tempest-VolumesSnapshotsTestJSON-162998172 tempest-VolumesSnapshotsTestJSON-162998172-project] Calling method '.version_select at 0x7fed01460af0>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:01:16.164443 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-ed062e84-a326-4892-9448-59293b4f5dcb tempest-VolumesSnapshotsTestJSON-162998172 tempest-VolumesSnapshotsTestJSON-162998172-project] HTTP exception thrown: Volume 770bbbe7-9012-4169-a3b7-e6fb442aad93 could not be found. Sep 13 00:01:16.166371 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ed062e84-a326-4892-9448-59293b4f5dcb tempest-VolumesSnapshotsTestJSON-162998172 tempest-VolumesSnapshotsTestJSON-162998172-project] Request method failure captured: Sep 13 00:01:16.166371 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: request: GET /compute/v2.1/os-volumes/770bbbe7-9012-4169-a3b7-e6fb442aad93 HTTP/1.1 Sep 13 00:01:16.166371 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept: application/json Sep 13 00:01:16.166371 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Sep 13 00:01:16.166371 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Connection: close Sep 13 00:01:16.166371 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Length: 0 Sep 13 00:01:16.166371 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Type: application/json Sep 13 00:01:16.166371 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Host: 10.222.0.26 Sep 13 00:01:16.166371 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Sep 13 00:01:16.166371 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Sep 13 00:01:16.166371 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjH8hE4alJjRwbIR9yJA0TKf2fPLfJDI5bYgTtbk8etZUm3my8tCVqpV7nSKeVRc7_BQiuOi2VWr3dgXg4M6IB4kcvOxSTXOcWLMsp8cB11RNZOCL8mDxqtQ44f7VsR45zUo6IWdMbF7r6MX-n145rFdzyOcBFYzyEGiVUxKqbNeDcm7s Sep 13 00:01:16.166371 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Sep 13 00:01:16.166371 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Sep 13 00:01:16.166371 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Sep 13 00:01:16.166371 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Sep 13 00:01:16.166371 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Sep 13 00:01:16.166371 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Sep 13 00:01:16.166371 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Id: 8f0e75134c574437943e4e551b4f0883 Sep 13 00:01:16.166371 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-162998172 Sep 13 00:01:16.166371 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Role: member,reader Sep 13 00:01:16.166371 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Roles: member,reader Sep 13 00:01:16.169108 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8f0e75134c574437943e4e551b4f0883"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8f0e75134c574437943e4e551b4f0883"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8f0e75134c574437943e4e551b4f0883"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8f0e75134c574437943e4e551b4f0883"}]}] Sep 13 00:01:16.169108 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-VolumesSnapshotsTestJSON-162998172 Sep 13 00:01:16.169108 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Id: 8f0e75134c574437943e4e551b4f0883 Sep 13 00:01:16.169108 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-162998172 Sep 13 00:01:16.169108 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User: tempest-VolumesSnapshotsTestJSON-162998172-project Sep 13 00:01:16.169108 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Sep 13 00:01:16.169108 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Sep 13 00:01:16.169108 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Id: 8f4781b08fec4b43bd28b7a8396ddb45 Sep 13 00:01:16.169108 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-VolumesSnapshotsTestJSON-162998172-project Sep 13 00:01:16.169108 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: method: Sep 13 00:01:16.169108 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: exception: Volume 770bbbe7-9012-4169-a3b7-e6fb442aad93 could not be found. Sep 13 00:01:16.169108 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: action_args: {'id': '770bbbe7-9012-4169-a3b7-e6fb442aad93'} Sep 13 00:01:16.169108 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 00:01:16.170231 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:01:16.170231 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 00:01:16.170231 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 00:01:16.170231 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 00:01:16.170231 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 00:01:16.170231 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 00:01:16.170231 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 00:01:16.170231 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 00:01:16.170231 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 00:01:16.170231 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 00:01:16.170231 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 00:01:16.170231 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 00:01:16.170231 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 00:01:16.170231 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 00:01:16.170231 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 00:01:16.170231 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 770bbbe7-9012-4169-a3b7-e6fb442aad93 could not be found. (HTTP 404) (Request-ID: req-41ed54da-683f-421b-9094-391b367a0c7b) Sep 13 00:01:16.170231 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:01:16.170231 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 00:01:16.170231 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:01:16.172435 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:01:16.172435 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 00:01:16.172435 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 00:01:16.172435 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 00:01:16.172435 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 00:01:16.172435 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 00:01:16.172435 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 00:01:16.172435 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 00:01:16.172435 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 00:01:16.172435 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 00:01:16.172435 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 00:01:16.172435 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 00:01:16.172435 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 00:01:16.172435 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 00:01:16.172435 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 00:01:16.172435 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 00:01:16.172435 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 00:01:16.172435 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 00:01:16.172435 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 00:01:16.176410 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 00:01:16.176410 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 00:01:16.176410 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 00:01:16.176410 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 00:01:16.176410 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 770bbbe7-9012-4169-a3b7-e6fb442aad93 could not be found. Sep 13 00:01:16.176410 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:01:16.176410 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 00:01:16.176410 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:01:16.176410 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:01:16.176410 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 00:01:16.176410 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 00:01:16.176410 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 00:01:16.176410 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 00:01:16.176410 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 00:01:16.176410 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 00:01:16.176410 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 00:01:16.176410 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 00:01:16.176410 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 00:01:16.176410 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 00:01:16.190732 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 770bbbe7-9012-4169-a3b7-e6fb442aad93 could not be found. Sep 13 00:01:16.190732 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:01:16.190732 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 00:01:16.190732 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:01:16.190732 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:01:16.190732 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 00:01:16.190732 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 00:01:16.190732 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 00:01:16.190732 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 00:01:16.190732 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 770bbbe7-9012-4169-a3b7-e6fb442aad93 could not be found. Sep 13 00:01:16.190732 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:01:16.190732 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ed062e84-a326-4892-9448-59293b4f5dcb tempest-VolumesSnapshotsTestJSON-162998172 tempest-VolumesSnapshotsTestJSON-162998172-project] Returning 404 to user: Volume 770bbbe7-9012-4169-a3b7-e6fb442aad93 could not be found. {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 00:01:16.190732 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ed062e84-a326-4892-9448-59293b4f5dcb tempest-VolumesSnapshotsTestJSON-162998172 tempest-VolumesSnapshotsTestJSON-162998172-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/770bbbe7-9012-4169-a3b7-e6fb442aad93" status: 404 len: 109 microversion: 2.1 time: 0.037733 Sep 13 00:01:16.190732 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 421/837] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Sep 13 00:01:16 2022] GET /compute/v2.1/os-volumes/770bbbe7-9012-4169-a3b7-e6fb442aad93 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 00:01:53.739858 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a7dd4a8b-f594-4905-906f-bbe708340ded tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-407605319", "imageRef": "22a47167-5e04-441a-a504-d76d82afc776", "flavorRef": "452", "networks": [{"uuid": "8f063293-b293-4d8e-a5d4-4190ebe90a2c"}]}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 00:01:53.808081 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.network.neutron [None req-a7dd4a8b-f594-4905-906f-bbe708340ded tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] validate_networks() for [('8f063293-b293-4d8e-a5d4-4190ebe90a2c', None, None, None, None, None)] {{(pid=126976) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 00:01:54.214431 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-a7dd4a8b-f594-4905-906f-bbe708340ded tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Flavor limits 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 00:01:54.214934 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-a7dd4a8b-f594-4905-906f-bbe708340ded tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Image limits 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 00:01:54.215517 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-a7dd4a8b-f594-4905-906f-bbe708340ded tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Flavor pref 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 00:01:54.215934 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-a7dd4a8b-f594-4905-906f-bbe708340ded tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Image pref 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 00:01:54.216359 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-a7dd4a8b-f594-4905-906f-bbe708340ded tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 00:01:54.226023 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a7dd4a8b-f594-4905-906f-bbe708340ded tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:01:54.226516 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a7dd4a8b-f594-4905-906f-bbe708340ded tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:01:54.226951 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a7dd4a8b-f594-4905-906f-bbe708340ded tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:01:54.228084 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a7dd4a8b-f594-4905-906f-bbe708340ded tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:01:54.228544 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a7dd4a8b-f594-4905-906f-bbe708340ded tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:01:54.228972 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a7dd4a8b-f594-4905-906f-bbe708340ded tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:01:54.249849 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-a7dd4a8b-f594-4905-906f-bbe708340ded tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Getting quotas for project 91ed638ab95f4f21ad4bcc886adf0df4. Resources: {'instances', 'cores', 'ram'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 00:01:54.257932 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-a7dd4a8b-f594-4905-906f-bbe708340ded tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Getting quotas for user 0236b1a2975247c9b325117f6918c80e and project 91ed638ab95f4f21ad4bcc886adf0df4. Resources: {'instances', 'cores', 'ram'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 00:01:54.279767 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a7dd4a8b-f594-4905-906f-bbe708340ded tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Going to run 1 instances... {{(pid=126976) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 00:01:54.283510 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a7dd4a8b-f594-4905-906f-bbe708340ded tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] [instance: 68212561-7ed6-4c15-8807-b646d5c8fe24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='22a47167-5e04-441a-a504-d76d82afc776',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126976) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 00:01:54.343949 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a7dd4a8b-f594-4905-906f-bbe708340ded tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.609452 Sep 13 00:01:54.345085 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 417/838] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Sep 13 00:01:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 00:01:54.358072 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 00:01:54.358665 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Tue Sep 13 00:01:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/68212561-7ed6-4c15-8807-b646d5c8fe24 (ip 10.222.0.26) !!! Sep 13 00:01:54.366792 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c720d7ad-2e4c-47a5-bbfd-188ccbc5acbf tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:01:54.367800 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c720d7ad-2e4c-47a5-bbfd-188ccbc5acbf tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] [instance: 68212561-7ed6-4c15-8807-b646d5c8fe24] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:01:54.454992 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c720d7ad-2e4c-47a5-bbfd-188ccbc5acbf tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0236b1a2975247c9b325117f6918c80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed638ab95f4f21ad4bcc886adf0df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:01:54.471388 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c720d7ad-2e4c-47a5-bbfd-188ccbc5acbf tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] 10.222.0.26 "GET /compute/v2.1/servers/68212561-7ed6-4c15-8807-b646d5c8fe24" status: 200 len: 1218 microversion: 2.1 time: 0.117817 Sep 13 00:01:54.472091 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 422/839] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:01:54 2022] GET /compute/v2.1/servers/68212561-7ed6-4c15-8807-b646d5c8fe24 => generated 1218 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:01:55.508935 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e59e14fb-1ab1-437a-afe2-8782d45a9945 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:01:55.509541 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e59e14fb-1ab1-437a-afe2-8782d45a9945 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] [instance: 68212561-7ed6-4c15-8807-b646d5c8fe24] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:01:55.517029 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e59e14fb-1ab1-437a-afe2-8782d45a9945 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:01:55.517553 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e59e14fb-1ab1-437a-afe2-8782d45a9945 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:01:55.517982 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e59e14fb-1ab1-437a-afe2-8782d45a9945 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:01:55.518685 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e59e14fb-1ab1-437a-afe2-8782d45a9945 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:01:55.519131 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e59e14fb-1ab1-437a-afe2-8782d45a9945 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:01:55.519572 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e59e14fb-1ab1-437a-afe2-8782d45a9945 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:01:55.602371 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e59e14fb-1ab1-437a-afe2-8782d45a9945 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0236b1a2975247c9b325117f6918c80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed638ab95f4f21ad4bcc886adf0df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:01:55.613032 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e59e14fb-1ab1-437a-afe2-8782d45a9945 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] 10.222.0.26 "GET /compute/v2.1/servers/68212561-7ed6-4c15-8807-b646d5c8fe24" status: 200 len: 1270 microversion: 2.1 time: 0.107787 Sep 13 00:01:55.628166 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 418/840] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:01:55 2022] GET /compute/v2.1/servers/68212561-7ed6-4c15-8807-b646d5c8fe24 => generated 1270 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:01:56.638652 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b9afeae4-9717-4cf9-afab-6f27e0c7ff42 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:01:56.640289 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b9afeae4-9717-4cf9-afab-6f27e0c7ff42 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] [instance: 68212561-7ed6-4c15-8807-b646d5c8fe24] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:01:56.647959 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b9afeae4-9717-4cf9-afab-6f27e0c7ff42 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:01:56.648481 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b9afeae4-9717-4cf9-afab-6f27e0c7ff42 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:01:56.648917 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b9afeae4-9717-4cf9-afab-6f27e0c7ff42 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:01:56.649633 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b9afeae4-9717-4cf9-afab-6f27e0c7ff42 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:01:56.650090 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b9afeae4-9717-4cf9-afab-6f27e0c7ff42 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:01:56.650516 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b9afeae4-9717-4cf9-afab-6f27e0c7ff42 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:01:56.892900 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b9afeae4-9717-4cf9-afab-6f27e0c7ff42 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0236b1a2975247c9b325117f6918c80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed638ab95f4f21ad4bcc886adf0df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:01:56.907110 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b9afeae4-9717-4cf9-afab-6f27e0c7ff42 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] 10.222.0.26 "GET /compute/v2.1/servers/68212561-7ed6-4c15-8807-b646d5c8fe24" status: 200 len: 1318 microversion: 2.1 time: 0.272594 Sep 13 00:01:56.908907 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 423/841] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:01:56 2022] GET /compute/v2.1/servers/68212561-7ed6-4c15-8807-b646d5c8fe24 => generated 1318 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:01:57.256850 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-874c66ff-8995-4d3e-94ef-0c6dc3e5c912 req-b0a001c7-faeb-490a-b25f-f9b35a1374a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68212561-7ed6-4c15-8807-b646d5c8fe24", "tag": "70141c5c-ab4f-4363-991b-b149f0bb880f"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 00:01:57.269901 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-874c66ff-8995-4d3e-94ef-0c6dc3e5c912 req-b0a001c7-faeb-490a-b25f-f9b35a1374a0 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:01:57.272978 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-874c66ff-8995-4d3e-94ef-0c6dc3e5c912 req-b0a001c7-faeb-490a-b25f-f9b35a1374a0 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:01:57.273836 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-874c66ff-8995-4d3e-94ef-0c6dc3e5c912 req-b0a001c7-faeb-490a-b25f-f9b35a1374a0 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:01:57.291650 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-874c66ff-8995-4d3e-94ef-0c6dc3e5c912 req-b0a001c7-faeb-490a-b25f-f9b35a1374a0 service nova] Creating event network-changed:70141c5c-ab4f-4363-991b-b149f0bb880f for instance 68212561-7ed6-4c15-8807-b646d5c8fe24 on hv-cinder-82002 Sep 13 00:01:57.298394 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-874c66ff-8995-4d3e-94ef-0c6dc3e5c912 req-b0a001c7-faeb-490a-b25f-f9b35a1374a0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045342 Sep 13 00:01:57.299768 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 419/842] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 13 00:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 00:01:57.935653 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-6eb851a3-995d-4033-952b-ae7d69d8d386 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:01:57.936609 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-6eb851a3-995d-4033-952b-ae7d69d8d386 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] [instance: 68212561-7ed6-4c15-8807-b646d5c8fe24] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:01:57.944420 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6eb851a3-995d-4033-952b-ae7d69d8d386 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:01:57.945013 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6eb851a3-995d-4033-952b-ae7d69d8d386 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:01:57.945506 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6eb851a3-995d-4033-952b-ae7d69d8d386 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:01:57.946436 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6eb851a3-995d-4033-952b-ae7d69d8d386 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:01:57.947144 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6eb851a3-995d-4033-952b-ae7d69d8d386 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:01:57.947778 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6eb851a3-995d-4033-952b-ae7d69d8d386 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:01:58.154769 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-6eb851a3-995d-4033-952b-ae7d69d8d386 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0236b1a2975247c9b325117f6918c80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed638ab95f4f21ad4bcc886adf0df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:01:58.165168 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-6eb851a3-995d-4033-952b-ae7d69d8d386 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] 10.222.0.26 "GET /compute/v2.1/servers/68212561-7ed6-4c15-8807-b646d5c8fe24" status: 200 len: 1318 microversion: 2.1 time: 0.233885 Sep 13 00:01:58.165813 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 424/843] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:01:57 2022] GET /compute/v2.1/servers/68212561-7ed6-4c15-8807-b646d5c8fe24 => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:01:59.193270 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-cef3dd10-7bf9-4614-85b0-9541441a8e99 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:01:59.195326 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-cef3dd10-7bf9-4614-85b0-9541441a8e99 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] [instance: 68212561-7ed6-4c15-8807-b646d5c8fe24] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:01:59.203431 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cef3dd10-7bf9-4614-85b0-9541441a8e99 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:01:59.204174 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cef3dd10-7bf9-4614-85b0-9541441a8e99 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:01:59.204788 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cef3dd10-7bf9-4614-85b0-9541441a8e99 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:01:59.205666 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cef3dd10-7bf9-4614-85b0-9541441a8e99 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:01:59.206323 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cef3dd10-7bf9-4614-85b0-9541441a8e99 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:01:59.206811 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-cef3dd10-7bf9-4614-85b0-9541441a8e99 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:01:59.405069 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-cef3dd10-7bf9-4614-85b0-9541441a8e99 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0236b1a2975247c9b325117f6918c80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed638ab95f4f21ad4bcc886adf0df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:01:59.416089 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-cef3dd10-7bf9-4614-85b0-9541441a8e99 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] 10.222.0.26 "GET /compute/v2.1/servers/68212561-7ed6-4c15-8807-b646d5c8fe24" status: 200 len: 1318 microversion: 2.1 time: 0.227769 Sep 13 00:01:59.416883 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 420/844] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:01:59 2022] GET /compute/v2.1/servers/68212561-7ed6-4c15-8807-b646d5c8fe24 => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:02:00.441609 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5a2e338f-7b7b-4ed5-8118-7e28429bdc3c tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:02:00.442330 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5a2e338f-7b7b-4ed5-8118-7e28429bdc3c tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] [instance: 68212561-7ed6-4c15-8807-b646d5c8fe24] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:02:00.449164 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5a2e338f-7b7b-4ed5-8118-7e28429bdc3c tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:02:00.449729 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5a2e338f-7b7b-4ed5-8118-7e28429bdc3c tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:02:00.450222 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5a2e338f-7b7b-4ed5-8118-7e28429bdc3c tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:02:00.450975 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5a2e338f-7b7b-4ed5-8118-7e28429bdc3c tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:02:00.451446 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5a2e338f-7b7b-4ed5-8118-7e28429bdc3c tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:02:00.451858 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5a2e338f-7b7b-4ed5-8118-7e28429bdc3c tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:02:00.593889 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5a2e338f-7b7b-4ed5-8118-7e28429bdc3c tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0236b1a2975247c9b325117f6918c80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed638ab95f4f21ad4bcc886adf0df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:02:00.601879 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5a2e338f-7b7b-4ed5-8118-7e28429bdc3c tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] 10.222.0.26 "GET /compute/v2.1/servers/68212561-7ed6-4c15-8807-b646d5c8fe24" status: 200 len: 1318 microversion: 2.1 time: 0.164154 Sep 13 00:02:00.602524 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 425/845] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:02:00 2022] GET /compute/v2.1/servers/68212561-7ed6-4c15-8807-b646d5c8fe24 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:02:01.082974 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-64720adb-71d8-471d-b1ce-5b7b90f65ba4 req-718da593-1675-4ff8-afa5-46682ad52168 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68212561-7ed6-4c15-8807-b646d5c8fe24", "name": "network-vif-plugged", "status": "completed", "tag": "70141c5c-ab4f-4363-991b-b149f0bb880f"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 00:02:01.100908 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-64720adb-71d8-471d-b1ce-5b7b90f65ba4 req-718da593-1675-4ff8-afa5-46682ad52168 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:02:01.103021 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-64720adb-71d8-471d-b1ce-5b7b90f65ba4 req-718da593-1675-4ff8-afa5-46682ad52168 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:02:01.105505 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-64720adb-71d8-471d-b1ce-5b7b90f65ba4 req-718da593-1675-4ff8-afa5-46682ad52168 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:02:01.123191 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-64720adb-71d8-471d-b1ce-5b7b90f65ba4 req-718da593-1675-4ff8-afa5-46682ad52168 service nova] Creating event network-vif-plugged:70141c5c-ab4f-4363-991b-b149f0bb880f for instance 68212561-7ed6-4c15-8807-b646d5c8fe24 on hv-cinder-82002 Sep 13 00:02:01.129298 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-64720adb-71d8-471d-b1ce-5b7b90f65ba4 req-718da593-1675-4ff8-afa5-46682ad52168 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053303 Sep 13 00:02:01.130261 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 421/846] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 13 00:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 00:02:01.625127 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0a83ef21-2707-4a8c-b31f-fe1912bfdf76 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:02:01.625809 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0a83ef21-2707-4a8c-b31f-fe1912bfdf76 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] [instance: 68212561-7ed6-4c15-8807-b646d5c8fe24] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:02:01.632687 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0a83ef21-2707-4a8c-b31f-fe1912bfdf76 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:02:01.633183 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0a83ef21-2707-4a8c-b31f-fe1912bfdf76 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:02:01.633647 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0a83ef21-2707-4a8c-b31f-fe1912bfdf76 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:02:01.634365 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0a83ef21-2707-4a8c-b31f-fe1912bfdf76 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:02:01.634815 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0a83ef21-2707-4a8c-b31f-fe1912bfdf76 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:02:01.635301 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0a83ef21-2707-4a8c-b31f-fe1912bfdf76 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:02:01.783796 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0a83ef21-2707-4a8c-b31f-fe1912bfdf76 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0236b1a2975247c9b325117f6918c80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed638ab95f4f21ad4bcc886adf0df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:02:01.793269 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0a83ef21-2707-4a8c-b31f-fe1912bfdf76 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] 10.222.0.26 "GET /compute/v2.1/servers/68212561-7ed6-4c15-8807-b646d5c8fe24" status: 200 len: 1318 microversion: 2.1 time: 0.172043 Sep 13 00:02:01.793885 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 426/847] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:02:01 2022] GET /compute/v2.1/servers/68212561-7ed6-4c15-8807-b646d5c8fe24 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:02:02.817293 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8020847c-c077-43fc-80ca-539856a55161 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:02:02.817963 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-8020847c-c077-43fc-80ca-539856a55161 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] [instance: 68212561-7ed6-4c15-8807-b646d5c8fe24] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:02:02.825988 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8020847c-c077-43fc-80ca-539856a55161 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:02:02.826595 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8020847c-c077-43fc-80ca-539856a55161 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:02:02.827105 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8020847c-c077-43fc-80ca-539856a55161 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:02:02.828000 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8020847c-c077-43fc-80ca-539856a55161 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:02:02.828470 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8020847c-c077-43fc-80ca-539856a55161 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:02:02.828900 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8020847c-c077-43fc-80ca-539856a55161 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:02:02.967580 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8020847c-c077-43fc-80ca-539856a55161 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0236b1a2975247c9b325117f6918c80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed638ab95f4f21ad4bcc886adf0df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:02:02.975551 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-8020847c-c077-43fc-80ca-539856a55161 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] 10.222.0.26 "GET /compute/v2.1/servers/68212561-7ed6-4c15-8807-b646d5c8fe24" status: 200 len: 1318 microversion: 2.1 time: 0.162609 Sep 13 00:02:02.976127 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 422/848] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:02:02 2022] GET /compute/v2.1/servers/68212561-7ed6-4c15-8807-b646d5c8fe24 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:02:04.002200 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-bf2b83ee-f534-43ae-b512-4da36239d410 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:02:04.002877 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-bf2b83ee-f534-43ae-b512-4da36239d410 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] [instance: 68212561-7ed6-4c15-8807-b646d5c8fe24] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:02:04.012626 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf2b83ee-f534-43ae-b512-4da36239d410 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:02:04.013182 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf2b83ee-f534-43ae-b512-4da36239d410 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:02:04.013736 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf2b83ee-f534-43ae-b512-4da36239d410 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:02:04.015108 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf2b83ee-f534-43ae-b512-4da36239d410 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:02:04.015781 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf2b83ee-f534-43ae-b512-4da36239d410 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:02:04.016386 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bf2b83ee-f534-43ae-b512-4da36239d410 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:02:04.163052 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-bf2b83ee-f534-43ae-b512-4da36239d410 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0236b1a2975247c9b325117f6918c80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed638ab95f4f21ad4bcc886adf0df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:02:04.171298 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-bf2b83ee-f534-43ae-b512-4da36239d410 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] 10.222.0.26 "GET /compute/v2.1/servers/68212561-7ed6-4c15-8807-b646d5c8fe24" status: 200 len: 1506 microversion: 2.1 time: 0.174677 Sep 13 00:02:04.171887 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 427/849] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:02:03 2022] GET /compute/v2.1/servers/68212561-7ed6-4c15-8807-b646d5c8fe24 => generated 1506 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:02:15.221346 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ab13d230-46c7-49ff-81fc-99ae51a5f639 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2099113578", "imageRef": "22a47167-5e04-441a-a504-d76d82afc776", "flavorRef": "452"}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 00:02:15.230247 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell0:SELECT=2 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:02:15.230967 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell0:SELECT=6 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:02:15.231843 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:02:15.232457 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=24 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:02:15.279625 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.network.neutron [None req-ab13d230-46c7-49ff-81fc-99ae51a5f639 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] validate_networks() for None {{(pid=126976) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 00:02:15.568095 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-ab13d230-46c7-49ff-81fc-99ae51a5f639 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Flavor limits 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 00:02:15.568514 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-ab13d230-46c7-49ff-81fc-99ae51a5f639 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Image limits 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 00:02:15.568953 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-ab13d230-46c7-49ff-81fc-99ae51a5f639 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Flavor pref 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 00:02:15.569358 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-ab13d230-46c7-49ff-81fc-99ae51a5f639 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Image pref 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 00:02:15.569764 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-ab13d230-46c7-49ff-81fc-99ae51a5f639 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 00:02:15.580808 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ab13d230-46c7-49ff-81fc-99ae51a5f639 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:02:15.581222 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ab13d230-46c7-49ff-81fc-99ae51a5f639 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:02:15.581660 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ab13d230-46c7-49ff-81fc-99ae51a5f639 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:02:15.582390 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ab13d230-46c7-49ff-81fc-99ae51a5f639 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:02:15.582834 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ab13d230-46c7-49ff-81fc-99ae51a5f639 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:02:15.583272 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ab13d230-46c7-49ff-81fc-99ae51a5f639 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:02:15.600416 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-ab13d230-46c7-49ff-81fc-99ae51a5f639 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Getting quotas for project 91502d4f18774f6c8d1640893889ec4e. Resources: {'instances', 'cores', 'ram'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 00:02:15.604502 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-ab13d230-46c7-49ff-81fc-99ae51a5f639 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Getting quotas for user c49c3c7e6a454ab5bc692a7a7b8df8cf and project 91502d4f18774f6c8d1640893889ec4e. Resources: {'instances', 'cores', 'ram'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 00:02:15.615707 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ab13d230-46c7-49ff-81fc-99ae51a5f639 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Going to run 1 instances... {{(pid=126976) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 00:02:15.618021 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ab13d230-46c7-49ff-81fc-99ae51a5f639 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] [instance: e87ee312-37b6-40c3-94ae-b8b6beba574f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='22a47167-5e04-441a-a504-d76d82afc776',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126976) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 00:02:15.666314 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ab13d230-46c7-49ff-81fc-99ae51a5f639 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.449268 Sep 13 00:02:15.666993 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 423/850] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Sep 13 00:02:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 451 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 00:02:15.678073 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4eeb16e3-6a5b-495c-83f6-6076d3dce446 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:02:15.678685 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4eeb16e3-6a5b-495c-83f6-6076d3dce446 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] [instance: e87ee312-37b6-40c3-94ae-b8b6beba574f] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:02:15.680636 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell0:SELECT=2 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:02:15.682196 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=14 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:02:15.683055 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=30 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:02:15.736591 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4eeb16e3-6a5b-495c-83f6-6076d3dce446 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49c3c7e6a454ab5bc692a7a7b8df8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91502d4f18774f6c8d1640893889ec4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:02:15.743320 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4eeb16e3-6a5b-495c-83f6-6076d3dce446 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] 10.222.0.26 "GET /compute/v2.1/servers/e87ee312-37b6-40c3-94ae-b8b6beba574f" status: 200 len: 1215 microversion: 2.1 time: 0.069086 Sep 13 00:02:15.744063 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 428/851] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:02:15 2022] GET /compute/v2.1/servers/e87ee312-37b6-40c3-94ae-b8b6beba574f => generated 1215 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:02:16.767781 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ff680bb0-21cb-4f7d-8544-5b15c726110a tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:02:16.768345 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ff680bb0-21cb-4f7d-8544-5b15c726110a tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] [instance: e87ee312-37b6-40c3-94ae-b8b6beba574f] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:02:16.777277 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ff680bb0-21cb-4f7d-8544-5b15c726110a tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:02:16.777768 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ff680bb0-21cb-4f7d-8544-5b15c726110a tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:02:16.778247 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ff680bb0-21cb-4f7d-8544-5b15c726110a tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:02:16.778919 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ff680bb0-21cb-4f7d-8544-5b15c726110a tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:02:16.779405 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ff680bb0-21cb-4f7d-8544-5b15c726110a tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:02:16.779864 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ff680bb0-21cb-4f7d-8544-5b15c726110a tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:02:17.162618 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ff680bb0-21cb-4f7d-8544-5b15c726110a tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49c3c7e6a454ab5bc692a7a7b8df8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91502d4f18774f6c8d1640893889ec4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:02:17.170758 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ff680bb0-21cb-4f7d-8544-5b15c726110a tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] 10.222.0.26 "GET /compute/v2.1/servers/e87ee312-37b6-40c3-94ae-b8b6beba574f" status: 200 len: 1275 microversion: 2.1 time: 0.408368 Sep 13 00:02:17.171371 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 424/852] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:02:16 2022] GET /compute/v2.1/servers/e87ee312-37b6-40c3-94ae-b8b6beba574f => generated 1275 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:02:18.193911 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-4288a712-70a0-4dfc-ab68-2a421c2a68f4 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:02:18.194499 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-4288a712-70a0-4dfc-ab68-2a421c2a68f4 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] [instance: e87ee312-37b6-40c3-94ae-b8b6beba574f] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:02:18.202145 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4288a712-70a0-4dfc-ab68-2a421c2a68f4 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:02:18.202878 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4288a712-70a0-4dfc-ab68-2a421c2a68f4 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:02:18.203338 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4288a712-70a0-4dfc-ab68-2a421c2a68f4 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:02:18.204026 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4288a712-70a0-4dfc-ab68-2a421c2a68f4 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:02:18.204470 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4288a712-70a0-4dfc-ab68-2a421c2a68f4 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:02:18.204881 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-4288a712-70a0-4dfc-ab68-2a421c2a68f4 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:02:18.428932 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-4288a712-70a0-4dfc-ab68-2a421c2a68f4 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49c3c7e6a454ab5bc692a7a7b8df8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91502d4f18774f6c8d1640893889ec4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:02:18.437519 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-4288a712-70a0-4dfc-ab68-2a421c2a68f4 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] 10.222.0.26 "GET /compute/v2.1/servers/e87ee312-37b6-40c3-94ae-b8b6beba574f" status: 200 len: 1315 microversion: 2.1 time: 0.247545 Sep 13 00:02:18.438105 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 429/853] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:02:18 2022] GET /compute/v2.1/servers/e87ee312-37b6-40c3-94ae-b8b6beba574f => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:02:18.706520 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-302f2c2b-48fd-41ca-9b06-95ac3fb21e42 req-d2eae926-7685-446f-8228-39b67474f7ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e87ee312-37b6-40c3-94ae-b8b6beba574f", "tag": "9ee159b3-4b95-4e4c-840f-8f112c2f63f9"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 00:02:18.717423 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-302f2c2b-48fd-41ca-9b06-95ac3fb21e42 req-d2eae926-7685-446f-8228-39b67474f7ba service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:02:18.718326 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-302f2c2b-48fd-41ca-9b06-95ac3fb21e42 req-d2eae926-7685-446f-8228-39b67474f7ba service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:02:18.718954 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-302f2c2b-48fd-41ca-9b06-95ac3fb21e42 req-d2eae926-7685-446f-8228-39b67474f7ba service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:02:18.730861 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-302f2c2b-48fd-41ca-9b06-95ac3fb21e42 req-d2eae926-7685-446f-8228-39b67474f7ba service nova] Creating event network-changed:9ee159b3-4b95-4e4c-840f-8f112c2f63f9 for instance e87ee312-37b6-40c3-94ae-b8b6beba574f on hv-cinder-82002 Sep 13 00:02:18.736206 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-302f2c2b-48fd-41ca-9b06-95ac3fb21e42 req-d2eae926-7685-446f-8228-39b67474f7ba service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033786 Sep 13 00:02:18.736801 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 425/854] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 13 00:02:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 00:02:19.460954 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-99c5ea54-6d6e-42b0-948d-5d5502c075a4 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:02:19.461565 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-99c5ea54-6d6e-42b0-948d-5d5502c075a4 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] [instance: e87ee312-37b6-40c3-94ae-b8b6beba574f] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:02:19.468534 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-99c5ea54-6d6e-42b0-948d-5d5502c075a4 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:02:19.469019 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-99c5ea54-6d6e-42b0-948d-5d5502c075a4 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:02:19.469446 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-99c5ea54-6d6e-42b0-948d-5d5502c075a4 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:02:19.470143 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-99c5ea54-6d6e-42b0-948d-5d5502c075a4 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:02:19.470597 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-99c5ea54-6d6e-42b0-948d-5d5502c075a4 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:02:19.471013 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-99c5ea54-6d6e-42b0-948d-5d5502c075a4 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:02:19.478708 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9846c500-43d2-4f38-9f67-5638dc7f6ec7 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52419836-c25c-48d4-a0e3-987551d8eb63", "device": "/dev/sdb"}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 00:02:19.481731 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9846c500-43d2-4f38-9f67-5638dc7f6ec7 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] [instance: 68212561-7ed6-4c15-8807-b646d5c8fe24] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:02:19.488113 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9846c500-43d2-4f38-9f67-5638dc7f6ec7 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:02:19.488599 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9846c500-43d2-4f38-9f67-5638dc7f6ec7 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:02:19.489019 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9846c500-43d2-4f38-9f67-5638dc7f6ec7 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:02:19.489712 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9846c500-43d2-4f38-9f67-5638dc7f6ec7 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:02:19.490152 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9846c500-43d2-4f38-9f67-5638dc7f6ec7 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:02:19.490567 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9846c500-43d2-4f38-9f67-5638dc7f6ec7 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:02:19.613492 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-99c5ea54-6d6e-42b0-948d-5d5502c075a4 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49c3c7e6a454ab5bc692a7a7b8df8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91502d4f18774f6c8d1640893889ec4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:02:19.621577 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-99c5ea54-6d6e-42b0-948d-5d5502c075a4 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] 10.222.0.26 "GET /compute/v2.1/servers/e87ee312-37b6-40c3-94ae-b8b6beba574f" status: 200 len: 1315 microversion: 2.1 time: 0.164545 Sep 13 00:02:19.622141 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 430/855] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:02:19 2022] GET /compute/v2.1/servers/e87ee312-37b6-40c3-94ae-b8b6beba574f => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:02:20.114989 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9846c500-43d2-4f38-9f67-5638dc7f6ec7 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] 10.222.0.26 "POST /compute/v2.1/servers/68212561-7ed6-4c15-8807-b646d5c8fe24/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.640367 Sep 13 00:02:20.115927 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 426/856] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Sep 13 00:02:19 2022] POST /compute/v2.1/servers/68212561-7ed6-4c15-8807-b646d5c8fe24/os-volume_attachments => generated 194 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 00:02:20.645085 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-97e79890-d52d-41e4-a055-8fd401f5767b tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:02:20.645703 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-97e79890-d52d-41e4-a055-8fd401f5767b tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] [instance: e87ee312-37b6-40c3-94ae-b8b6beba574f] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:02:20.652524 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-97e79890-d52d-41e4-a055-8fd401f5767b tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:02:20.653025 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-97e79890-d52d-41e4-a055-8fd401f5767b tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:02:20.653458 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-97e79890-d52d-41e4-a055-8fd401f5767b tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:02:20.654157 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-97e79890-d52d-41e4-a055-8fd401f5767b tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:02:20.654603 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-97e79890-d52d-41e4-a055-8fd401f5767b tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:02:20.655024 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-97e79890-d52d-41e4-a055-8fd401f5767b tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:02:20.959254 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-97e79890-d52d-41e4-a055-8fd401f5767b tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49c3c7e6a454ab5bc692a7a7b8df8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91502d4f18774f6c8d1640893889ec4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:02:20.967114 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-97e79890-d52d-41e4-a055-8fd401f5767b tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] 10.222.0.26 "GET /compute/v2.1/servers/e87ee312-37b6-40c3-94ae-b8b6beba574f" status: 200 len: 1315 microversion: 2.1 time: 0.325968 Sep 13 00:02:20.967723 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 431/857] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:02:20 2022] GET /compute/v2.1/servers/e87ee312-37b6-40c3-94ae-b8b6beba574f => generated 1315 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:02:21.992865 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b26686eb-a73f-44eb-964a-bbf02f400374 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:02:21.993632 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b26686eb-a73f-44eb-964a-bbf02f400374 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] [instance: e87ee312-37b6-40c3-94ae-b8b6beba574f] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:02:22.001412 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b26686eb-a73f-44eb-964a-bbf02f400374 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:02:22.002012 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b26686eb-a73f-44eb-964a-bbf02f400374 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:02:22.002544 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b26686eb-a73f-44eb-964a-bbf02f400374 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:02:22.003457 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b26686eb-a73f-44eb-964a-bbf02f400374 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:02:22.004072 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b26686eb-a73f-44eb-964a-bbf02f400374 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:02:22.004587 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b26686eb-a73f-44eb-964a-bbf02f400374 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:02:22.149873 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b26686eb-a73f-44eb-964a-bbf02f400374 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49c3c7e6a454ab5bc692a7a7b8df8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91502d4f18774f6c8d1640893889ec4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:02:22.157774 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b26686eb-a73f-44eb-964a-bbf02f400374 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] 10.222.0.26 "GET /compute/v2.1/servers/e87ee312-37b6-40c3-94ae-b8b6beba574f" status: 200 len: 1315 microversion: 2.1 time: 0.170771 Sep 13 00:02:22.158344 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 427/858] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:02:21 2022] GET /compute/v2.1/servers/e87ee312-37b6-40c3-94ae-b8b6beba574f => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:02:23.121488 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-fe5b16a3-f946-4ea6-ab66-f606b4876191 req-c272d260-a80b-48a5-abe6-1fe22618740d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e87ee312-37b6-40c3-94ae-b8b6beba574f", "name": "network-vif-plugged", "status": "completed", "tag": "9ee159b3-4b95-4e4c-840f-8f112c2f63f9"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 00:02:23.131079 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-fe5b16a3-f946-4ea6-ab66-f606b4876191 req-c272d260-a80b-48a5-abe6-1fe22618740d service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:02:23.131808 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-fe5b16a3-f946-4ea6-ab66-f606b4876191 req-c272d260-a80b-48a5-abe6-1fe22618740d service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:02:23.132225 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-fe5b16a3-f946-4ea6-ab66-f606b4876191 req-c272d260-a80b-48a5-abe6-1fe22618740d service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:02:23.143657 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-fe5b16a3-f946-4ea6-ab66-f606b4876191 req-c272d260-a80b-48a5-abe6-1fe22618740d service nova] Creating event network-vif-plugged:9ee159b3-4b95-4e4c-840f-8f112c2f63f9 for instance e87ee312-37b6-40c3-94ae-b8b6beba574f on hv-cinder-82002 Sep 13 00:02:23.148825 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-fe5b16a3-f946-4ea6-ab66-f606b4876191 req-c272d260-a80b-48a5-abe6-1fe22618740d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031259 Sep 13 00:02:23.149413 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 432/859] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 13 00:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 00:02:23.180870 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-74947ac0-82ee-4390-bcc1-68ae4141417a tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:02:23.182306 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-74947ac0-82ee-4390-bcc1-68ae4141417a tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] [instance: e87ee312-37b6-40c3-94ae-b8b6beba574f] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:02:23.190083 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-74947ac0-82ee-4390-bcc1-68ae4141417a tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:02:23.190569 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-74947ac0-82ee-4390-bcc1-68ae4141417a tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:02:23.191009 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-74947ac0-82ee-4390-bcc1-68ae4141417a tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:02:23.191772 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-74947ac0-82ee-4390-bcc1-68ae4141417a tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:02:23.192246 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-74947ac0-82ee-4390-bcc1-68ae4141417a tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:02:23.192697 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-74947ac0-82ee-4390-bcc1-68ae4141417a tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:02:23.378199 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-74947ac0-82ee-4390-bcc1-68ae4141417a tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49c3c7e6a454ab5bc692a7a7b8df8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91502d4f18774f6c8d1640893889ec4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:02:23.391157 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-74947ac0-82ee-4390-bcc1-68ae4141417a tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] 10.222.0.26 "GET /compute/v2.1/servers/e87ee312-37b6-40c3-94ae-b8b6beba574f" status: 200 len: 1315 microversion: 2.1 time: 0.214341 Sep 13 00:02:23.391788 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 428/860] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:02:23 2022] GET /compute/v2.1/servers/e87ee312-37b6-40c3-94ae-b8b6beba574f => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:02:24.415195 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-65833150-6d42-4f5f-a2a6-0b8b5457164a tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:02:24.415913 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-65833150-6d42-4f5f-a2a6-0b8b5457164a tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] [instance: e87ee312-37b6-40c3-94ae-b8b6beba574f] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:02:24.422333 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-65833150-6d42-4f5f-a2a6-0b8b5457164a tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:02:24.422774 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-65833150-6d42-4f5f-a2a6-0b8b5457164a tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:02:24.423198 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-65833150-6d42-4f5f-a2a6-0b8b5457164a tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:02:24.423919 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-65833150-6d42-4f5f-a2a6-0b8b5457164a tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:02:24.424368 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-65833150-6d42-4f5f-a2a6-0b8b5457164a tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:02:24.424784 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-65833150-6d42-4f5f-a2a6-0b8b5457164a tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:02:24.563460 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-65833150-6d42-4f5f-a2a6-0b8b5457164a tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49c3c7e6a454ab5bc692a7a7b8df8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91502d4f18774f6c8d1640893889ec4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:02:24.571424 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-65833150-6d42-4f5f-a2a6-0b8b5457164a tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] 10.222.0.26 "GET /compute/v2.1/servers/e87ee312-37b6-40c3-94ae-b8b6beba574f" status: 200 len: 1315 microversion: 2.1 time: 0.161093 Sep 13 00:02:24.571987 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 433/861] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:02:24 2022] GET /compute/v2.1/servers/e87ee312-37b6-40c3-94ae-b8b6beba574f => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:02:25.595123 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b73605ce-4a78-4ef7-b26f-0d398056dcff tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:02:25.595727 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b73605ce-4a78-4ef7-b26f-0d398056dcff tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] [instance: e87ee312-37b6-40c3-94ae-b8b6beba574f] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:02:25.598200 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell0:SELECT=2 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:02:25.604134 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b73605ce-4a78-4ef7-b26f-0d398056dcff tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:02:25.604641 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b73605ce-4a78-4ef7-b26f-0d398056dcff tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:02:25.605063 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b73605ce-4a78-4ef7-b26f-0d398056dcff tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:02:25.605764 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b73605ce-4a78-4ef7-b26f-0d398056dcff tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:02:25.606197 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b73605ce-4a78-4ef7-b26f-0d398056dcff tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:02:25.606641 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b73605ce-4a78-4ef7-b26f-0d398056dcff tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:02:25.611045 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell0:SELECT=6 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:02:25.743670 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b73605ce-4a78-4ef7-b26f-0d398056dcff tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49c3c7e6a454ab5bc692a7a7b8df8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91502d4f18774f6c8d1640893889ec4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:02:25.755937 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b73605ce-4a78-4ef7-b26f-0d398056dcff tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] 10.222.0.26 "GET /compute/v2.1/servers/e87ee312-37b6-40c3-94ae-b8b6beba574f" status: 200 len: 1463 microversion: 2.1 time: 0.164819 Sep 13 00:02:25.756656 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 429/862] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:02:25 2022] GET /compute/v2.1/servers/e87ee312-37b6-40c3-94ae-b8b6beba574f => generated 1463 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:02:25.808335 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-e67fa3d2-6ef0-4323-959c-65ebfadabb64 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:02:25.809081 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e67fa3d2-6ef0-4323-959c-65ebfadabb64 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] [instance: e87ee312-37b6-40c3-94ae-b8b6beba574f] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:02:25.812915 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell0:SELECT=2 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:02:25.820750 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e67fa3d2-6ef0-4323-959c-65ebfadabb64 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:02:25.821522 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e67fa3d2-6ef0-4323-959c-65ebfadabb64 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:02:25.822208 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e67fa3d2-6ef0-4323-959c-65ebfadabb64 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:02:25.823321 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e67fa3d2-6ef0-4323-959c-65ebfadabb64 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:02:25.823948 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e67fa3d2-6ef0-4323-959c-65ebfadabb64 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:02:25.824365 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-e67fa3d2-6ef0-4323-959c-65ebfadabb64 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:02:25.850287 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-e67fa3d2-6ef0-4323-959c-65ebfadabb64 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] [instance: e87ee312-37b6-40c3-94ae-b8b6beba574f] Going to try to terminate instance {{(pid=126975) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 00:02:25.939843 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-e67fa3d2-6ef0-4323-959c-65ebfadabb64 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e87ee312-37b6-40c3-94ae-b8b6beba574f" status: 204 len: 0 microversion: 2.1 time: 0.137162 Sep 13 00:02:25.940422 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 434/863] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Sep 13 00:02:25 2022] DELETE /compute/v2.1/servers/e87ee312-37b6-40c3-94ae-b8b6beba574f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 00:02:25.948845 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-356dc3f5-c33a-4bf6-b06a-b0016288d390 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:02:25.949461 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-356dc3f5-c33a-4bf6-b06a-b0016288d390 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] [instance: e87ee312-37b6-40c3-94ae-b8b6beba574f] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:02:25.955985 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-356dc3f5-c33a-4bf6-b06a-b0016288d390 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:02:25.956473 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-356dc3f5-c33a-4bf6-b06a-b0016288d390 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:02:25.956910 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-356dc3f5-c33a-4bf6-b06a-b0016288d390 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:02:25.957607 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-356dc3f5-c33a-4bf6-b06a-b0016288d390 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:02:25.958069 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-356dc3f5-c33a-4bf6-b06a-b0016288d390 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:02:25.958505 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-356dc3f5-c33a-4bf6-b06a-b0016288d390 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:02:26.099483 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-356dc3f5-c33a-4bf6-b06a-b0016288d390 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49c3c7e6a454ab5bc692a7a7b8df8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91502d4f18774f6c8d1640893889ec4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:02:26.107755 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-356dc3f5-c33a-4bf6-b06a-b0016288d390 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] 10.222.0.26 "GET /compute/v2.1/servers/e87ee312-37b6-40c3-94ae-b8b6beba574f" status: 200 len: 1469 microversion: 2.1 time: 0.162816 Sep 13 00:02:26.108319 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 430/864] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:02:25 2022] GET /compute/v2.1/servers/e87ee312-37b6-40c3-94ae-b8b6beba574f => generated 1469 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:02:27.138170 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c85acc49-ce80-42c2-86ba-c28991af8b10 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:02:27.139247 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c85acc49-ce80-42c2-86ba-c28991af8b10 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] [instance: e87ee312-37b6-40c3-94ae-b8b6beba574f] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:02:27.146293 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c85acc49-ce80-42c2-86ba-c28991af8b10 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:02:27.146783 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c85acc49-ce80-42c2-86ba-c28991af8b10 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:02:27.147212 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c85acc49-ce80-42c2-86ba-c28991af8b10 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:02:27.147938 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c85acc49-ce80-42c2-86ba-c28991af8b10 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:02:27.148394 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c85acc49-ce80-42c2-86ba-c28991af8b10 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:02:27.148812 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c85acc49-ce80-42c2-86ba-c28991af8b10 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:02:27.295400 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c85acc49-ce80-42c2-86ba-c28991af8b10 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49c3c7e6a454ab5bc692a7a7b8df8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91502d4f18774f6c8d1640893889ec4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:02:27.303644 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c85acc49-ce80-42c2-86ba-c28991af8b10 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] 10.222.0.26 "GET /compute/v2.1/servers/e87ee312-37b6-40c3-94ae-b8b6beba574f" status: 200 len: 1469 microversion: 2.1 time: 0.170748 Sep 13 00:02:27.304185 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 435/865] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:02:27 2022] GET /compute/v2.1/servers/e87ee312-37b6-40c3-94ae-b8b6beba574f => generated 1469 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:02:28.157418 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-b32d42b8-27c6-4f00-8d4a-10e1b1ef20ba req-6a2f4a88-3281-4f21-9e85-c10d3eb40be5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e87ee312-37b6-40c3-94ae-b8b6beba574f", "name": "network-vif-deleted", "tag": "9ee159b3-4b95-4e4c-840f-8f112c2f63f9"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 00:02:28.167645 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-b32d42b8-27c6-4f00-8d4a-10e1b1ef20ba req-6a2f4a88-3281-4f21-9e85-c10d3eb40be5 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:02:28.168115 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-b32d42b8-27c6-4f00-8d4a-10e1b1ef20ba req-6a2f4a88-3281-4f21-9e85-c10d3eb40be5 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:02:28.168535 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-b32d42b8-27c6-4f00-8d4a-10e1b1ef20ba req-6a2f4a88-3281-4f21-9e85-c10d3eb40be5 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:02:28.180963 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-b32d42b8-27c6-4f00-8d4a-10e1b1ef20ba req-6a2f4a88-3281-4f21-9e85-c10d3eb40be5 service nova] Creating event network-vif-deleted:9ee159b3-4b95-4e4c-840f-8f112c2f63f9 for instance e87ee312-37b6-40c3-94ae-b8b6beba574f on hv-cinder-82002 Sep 13 00:02:28.186856 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-b32d42b8-27c6-4f00-8d4a-10e1b1ef20ba req-6a2f4a88-3281-4f21-9e85-c10d3eb40be5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032964 Sep 13 00:02:28.187784 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 431/866] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 13 00:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 00:02:28.326743 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2f55ad67-91e5-49c8-bfcc-9ead736fe50d tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:02:28.327511 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2f55ad67-91e5-49c8-bfcc-9ead736fe50d tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] [instance: e87ee312-37b6-40c3-94ae-b8b6beba574f] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:02:28.334137 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2f55ad67-91e5-49c8-bfcc-9ead736fe50d tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:02:28.334613 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2f55ad67-91e5-49c8-bfcc-9ead736fe50d tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:02:28.335042 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2f55ad67-91e5-49c8-bfcc-9ead736fe50d tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:02:28.335826 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2f55ad67-91e5-49c8-bfcc-9ead736fe50d tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:02:28.336277 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2f55ad67-91e5-49c8-bfcc-9ead736fe50d tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:02:28.336743 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2f55ad67-91e5-49c8-bfcc-9ead736fe50d tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:02:28.370440 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2f55ad67-91e5-49c8-bfcc-9ead736fe50d tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:02:28.370984 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2f55ad67-91e5-49c8-bfcc-9ead736fe50d tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:02:28.371449 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2f55ad67-91e5-49c8-bfcc-9ead736fe50d tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:02:28.371895 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.objects.instance [None req-2f55ad67-91e5-49c8-bfcc-9ead736fe50d tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Lazy-loading 'fault' on Instance uuid e87ee312-37b6-40c3-94ae-b8b6beba574f {{(pid=126975) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 00:02:28.413969 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2f55ad67-91e5-49c8-bfcc-9ead736fe50d tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c49c3c7e6a454ab5bc692a7a7b8df8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91502d4f18774f6c8d1640893889ec4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:02:28.422368 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2f55ad67-91e5-49c8-bfcc-9ead736fe50d tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] 10.222.0.26 "GET /compute/v2.1/servers/e87ee312-37b6-40c3-94ae-b8b6beba574f" status: 200 len: 1305 microversion: 2.1 time: 0.099591 Sep 13 00:02:28.422951 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 436/867] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:02:28 2022] GET /compute/v2.1/servers/e87ee312-37b6-40c3-94ae-b8b6beba574f => generated 1305 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:02:29.452197 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8c466375-4a20-4ff8-a5df-4ac68b677f57 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:02:29.452890 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-8c466375-4a20-4ff8-a5df-4ac68b677f57 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] [instance: e87ee312-37b6-40c3-94ae-b8b6beba574f] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:02:29.460276 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8c466375-4a20-4ff8-a5df-4ac68b677f57 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:02:29.460755 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8c466375-4a20-4ff8-a5df-4ac68b677f57 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:02:29.461192 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8c466375-4a20-4ff8-a5df-4ac68b677f57 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:02:29.461887 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8c466375-4a20-4ff8-a5df-4ac68b677f57 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:02:29.462343 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8c466375-4a20-4ff8-a5df-4ac68b677f57 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:02:29.462765 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8c466375-4a20-4ff8-a5df-4ac68b677f57 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:02:29.476806 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-8c466375-4a20-4ff8-a5df-4ac68b677f57 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] HTTP exception thrown: Instance e87ee312-37b6-40c3-94ae-b8b6beba574f could not be found. Sep 13 00:02:29.478477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8c466375-4a20-4ff8-a5df-4ac68b677f57 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Request method failure captured: Sep 13 00:02:29.478477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: request: GET /compute/v2.1/servers/e87ee312-37b6-40c3-94ae-b8b6beba574f HTTP/1.1 Sep 13 00:02:29.478477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Accept: application/json Sep 13 00:02:29.478477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Sep 13 00:02:29.478477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Connection: close Sep 13 00:02:29.478477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Content-Length: 0 Sep 13 00:02:29.478477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Content-Type: application/json Sep 13 00:02:29.478477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Host: 10.222.0.26 Sep 13 00:02:29.478477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Sep 13 00:02:29.478477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Sep 13 00:02:29.478477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjH8iFycI2GzGFYwXc0o-HpNxRnmjxPr6vWxIPkoNee4pAFyL2DikTFUkpamAbi3vedD1qQlKtsFqlHDds6errw3dCax3lWP6Jt7y78HaZvRZsJs-NT8P8Gq7htV2myiVRgA7TuScrRYyOMsRJg-MMdFve6q5ghE52ZF0hs7Jd1dVzGPQ Sep 13 00:02:29.478477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Sep 13 00:02:29.478477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Sep 13 00:02:29.478477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Sep 13 00:02:29.478477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Sep 13 00:02:29.478477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Sep 13 00:02:29.478477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Sep 13 00:02:29.478477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Id: 91502d4f18774f6c8d1640893889ec4e Sep 13 00:02:29.478477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-VolumesNegativeTest-768576973 Sep 13 00:02:29.478477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Role: member,reader Sep 13 00:02:29.478477 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Roles: member,reader Sep 13 00:02:29.480159 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/91502d4f18774f6c8d1640893889ec4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/91502d4f18774f6c8d1640893889ec4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_91502d4f18774f6c8d1640893889ec4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/91502d4f18774f6c8d1640893889ec4e"}]}] Sep 13 00:02:29.480159 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-VolumesNegativeTest-768576973 Sep 13 00:02:29.480159 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant-Id: 91502d4f18774f6c8d1640893889ec4e Sep 13 00:02:29.480159 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-VolumesNegativeTest-768576973 Sep 13 00:02:29.480159 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User: tempest-VolumesNegativeTest-768576973-project Sep 13 00:02:29.480159 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Sep 13 00:02:29.480159 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Sep 13 00:02:29.480159 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Id: c49c3c7e6a454ab5bc692a7a7b8df8cf Sep 13 00:02:29.480159 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-VolumesNegativeTest-768576973-project Sep 13 00:02:29.480159 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: method: > Sep 13 00:02:29.480159 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: exception: Instance e87ee312-37b6-40c3-94ae-b8b6beba574f could not be found. Sep 13 00:02:29.480159 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: action_args: {'id': 'e87ee312-37b6-40c3-94ae-b8b6beba574f'} Sep 13 00:02:29.481298 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 00:02:29.481298 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:02:29.481298 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 00:02:29.481298 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 00:02:29.481298 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 00:02:29.481298 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 00:02:29.481298 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 00:02:29.481298 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 00:02:29.481298 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 00:02:29.481298 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 00:02:29.481298 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e87ee312-37b6-40c3-94ae-b8b6beba574f could not be found. Sep 13 00:02:29.481298 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:02:29.481298 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 00:02:29.481298 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:02:29.481298 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:02:29.481298 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 00:02:29.481298 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 00:02:29.481298 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 00:02:29.481298 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 00:02:29.481298 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 00:02:29.482834 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 00:02:29.482834 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 00:02:29.482834 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 00:02:29.482834 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 00:02:29.482834 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 00:02:29.482834 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 00:02:29.482834 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 00:02:29.482834 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e87ee312-37b6-40c3-94ae-b8b6beba574f could not be found. Sep 13 00:02:29.482834 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:02:29.482834 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 00:02:29.482834 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:02:29.482834 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:02:29.482834 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 00:02:29.482834 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 00:02:29.482834 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 00:02:29.482834 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 00:02:29.482834 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e87ee312-37b6-40c3-94ae-b8b6beba574f could not be found. Sep 13 00:02:29.482834 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:02:29.484254 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8c466375-4a20-4ff8-a5df-4ac68b677f57 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] Returning 404 to user: Instance e87ee312-37b6-40c3-94ae-b8b6beba574f could not be found. {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 00:02:29.484254 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-8c466375-4a20-4ff8-a5df-4ac68b677f57 tempest-VolumesNegativeTest-768576973 tempest-VolumesNegativeTest-768576973-project] 10.222.0.26 "GET /compute/v2.1/servers/e87ee312-37b6-40c3-94ae-b8b6beba574f" status: 404 len: 111 microversion: 2.1 time: 0.036349 Sep 13 00:02:29.484254 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 432/868] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:02:29 2022] GET /compute/v2.1/servers/e87ee312-37b6-40c3-94ae-b8b6beba574f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 00:02:44.400589 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:02:44.403014 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:02:44.600401 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a6fa6363-a0ac-4c45-a290-303047d67611 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Action: 'create', calling method: .version_select at 0x7fed01313430>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1764420964", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEvYCGZmEqaFXUiFF/cON7K6hw0VvhMz1ClBovhOVNNsf5Vu+VYwwUpi0EN2eXeXPBMwyx22wlAK+BjFYJcNw2UmqjbFvh/jYfrKGLpKZ5dpHKewLP//sP2YY9e4yNy0XA=="}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 00:02:44.619293 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-a6fa6363-a0ac-4c45-a290-303047d67611 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Getting quotas for project ecac3196aefa4c32994f85a86849c8c8. Resources: {'key_pairs'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 00:02:44.623620 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-a6fa6363-a0ac-4c45-a290-303047d67611 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Getting quotas for user f72b7cf8bf38477d8d6534eda6611982 and project ecac3196aefa4c32994f85a86849c8c8. Resources: {'key_pairs'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 00:02:44.651736 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a6fa6363-a0ac-4c45-a290-303047d67611 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.256956 Sep 13 00:02:44.653105 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 437/869] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Sep 13 00:02:44 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 00:02:45.338800 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-64ffae17-76dc-458d-ae11-ac5ae98efb31 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:02:45.339334 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-64ffae17-76dc-458d-ae11-ac5ae98efb31 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] [instance: 68212561-7ed6-4c15-8807-b646d5c8fe24] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:02:45.344321 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:02:45.345343 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:02:45.350000 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-64ffae17-76dc-458d-ae11-ac5ae98efb31 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:02:45.350469 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-64ffae17-76dc-458d-ae11-ac5ae98efb31 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:02:45.351565 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-64ffae17-76dc-458d-ae11-ac5ae98efb31 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:02:45.352259 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-64ffae17-76dc-458d-ae11-ac5ae98efb31 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:02:45.352701 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-64ffae17-76dc-458d-ae11-ac5ae98efb31 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:02:45.353111 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-64ffae17-76dc-458d-ae11-ac5ae98efb31 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:02:45.452897 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.objects.instance [None req-64ffae17-76dc-458d-ae11-ac5ae98efb31 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lazy-loading 'services' on Instance uuid 68212561-7ed6-4c15-8807-b646d5c8fe24 {{(pid=126976) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 00:02:45.539330 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-64ffae17-76dc-458d-ae11-ac5ae98efb31 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] 10.222.0.26 "DELETE /compute/v2.1/servers/68212561-7ed6-4c15-8807-b646d5c8fe24/os-volume_attachments/52419836-c25c-48d4-a0e3-987551d8eb63" status: 202 len: 0 microversion: 2.1 time: 0.204724 Sep 13 00:02:45.540130 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 433/870] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Sep 13 00:02:45 2022] DELETE /compute/v2.1/servers/68212561-7ed6-4c15-8807-b646d5c8fe24/os-volume_attachments/52419836-c25c-48d4-a0e3-987551d8eb63 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 00:02:46.675506 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c6b4dada-5075-4b07-b90e-4e1370e3038a tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:02:46.676204 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c6b4dada-5075-4b07-b90e-4e1370e3038a tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] [instance: 68212561-7ed6-4c15-8807-b646d5c8fe24] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:02:46.683346 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c6b4dada-5075-4b07-b90e-4e1370e3038a tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:02:46.683840 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c6b4dada-5075-4b07-b90e-4e1370e3038a tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:02:46.684277 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c6b4dada-5075-4b07-b90e-4e1370e3038a tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:02:46.684991 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c6b4dada-5075-4b07-b90e-4e1370e3038a tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:02:46.685444 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c6b4dada-5075-4b07-b90e-4e1370e3038a tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:02:46.685862 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c6b4dada-5075-4b07-b90e-4e1370e3038a tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:02:46.713875 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c6b4dada-5075-4b07-b90e-4e1370e3038a tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] [instance: 68212561-7ed6-4c15-8807-b646d5c8fe24] Going to try to terminate instance {{(pid=126975) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 00:02:46.800255 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c6b4dada-5075-4b07-b90e-4e1370e3038a tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] 10.222.0.26 "DELETE /compute/v2.1/servers/68212561-7ed6-4c15-8807-b646d5c8fe24" status: 204 len: 0 microversion: 2.1 time: 0.128439 Sep 13 00:02:46.801381 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 438/871] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Sep 13 00:02:46 2022] DELETE /compute/v2.1/servers/68212561-7ed6-4c15-8807-b646d5c8fe24 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 00:02:46.810822 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2c6685c3-4d42-4cd7-89b3-73ced84e0411 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:02:46.811545 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2c6685c3-4d42-4cd7-89b3-73ced84e0411 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] [instance: 68212561-7ed6-4c15-8807-b646d5c8fe24] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:02:46.818265 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2c6685c3-4d42-4cd7-89b3-73ced84e0411 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:02:46.818749 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2c6685c3-4d42-4cd7-89b3-73ced84e0411 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:02:46.819198 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2c6685c3-4d42-4cd7-89b3-73ced84e0411 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:02:46.820350 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2c6685c3-4d42-4cd7-89b3-73ced84e0411 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:02:46.820350 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2c6685c3-4d42-4cd7-89b3-73ced84e0411 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:02:46.820776 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2c6685c3-4d42-4cd7-89b3-73ced84e0411 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:02:46.981354 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2c6685c3-4d42-4cd7-89b3-73ced84e0411 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0236b1a2975247c9b325117f6918c80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed638ab95f4f21ad4bcc886adf0df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:02:46.989643 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2c6685c3-4d42-4cd7-89b3-73ced84e0411 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] 10.222.0.26 "GET /compute/v2.1/servers/68212561-7ed6-4c15-8807-b646d5c8fe24" status: 200 len: 1512 microversion: 2.1 time: 0.183679 Sep 13 00:02:46.990223 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 434/872] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:02:46 2022] GET /compute/v2.1/servers/68212561-7ed6-4c15-8807-b646d5c8fe24 => generated 1512 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:02:48.014744 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-031223ea-27e6-4294-9576-0307a03df21f tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:02:48.015682 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-031223ea-27e6-4294-9576-0307a03df21f tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] [instance: 68212561-7ed6-4c15-8807-b646d5c8fe24] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:02:48.023081 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-031223ea-27e6-4294-9576-0307a03df21f tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:02:48.023666 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-031223ea-27e6-4294-9576-0307a03df21f tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:02:48.024107 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-031223ea-27e6-4294-9576-0307a03df21f tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:02:48.024833 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-031223ea-27e6-4294-9576-0307a03df21f tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:02:48.025399 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-031223ea-27e6-4294-9576-0307a03df21f tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:02:48.025826 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-031223ea-27e6-4294-9576-0307a03df21f tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:02:48.168045 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-031223ea-27e6-4294-9576-0307a03df21f tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0236b1a2975247c9b325117f6918c80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed638ab95f4f21ad4bcc886adf0df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:02:48.176021 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-031223ea-27e6-4294-9576-0307a03df21f tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] 10.222.0.26 "GET /compute/v2.1/servers/68212561-7ed6-4c15-8807-b646d5c8fe24" status: 200 len: 1512 microversion: 2.1 time: 0.166175 Sep 13 00:02:48.176593 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 439/873] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:02:48 2022] GET /compute/v2.1/servers/68212561-7ed6-4c15-8807-b646d5c8fe24 => generated 1512 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:02:49.134952 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-b8f5a978-d5c9-4fd1-81ff-becf0cbaa197 req-b87d15a8-bf92-49d4-8e67-5c6227695e6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68212561-7ed6-4c15-8807-b646d5c8fe24", "name": "network-vif-deleted", "tag": "70141c5c-ab4f-4363-991b-b149f0bb880f"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 00:02:49.147998 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-b8f5a978-d5c9-4fd1-81ff-becf0cbaa197 req-b87d15a8-bf92-49d4-8e67-5c6227695e6b service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:02:49.148700 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-b8f5a978-d5c9-4fd1-81ff-becf0cbaa197 req-b87d15a8-bf92-49d4-8e67-5c6227695e6b service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:02:49.149159 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-b8f5a978-d5c9-4fd1-81ff-becf0cbaa197 req-b87d15a8-bf92-49d4-8e67-5c6227695e6b service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:02:49.162465 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-b8f5a978-d5c9-4fd1-81ff-becf0cbaa197 req-b87d15a8-bf92-49d4-8e67-5c6227695e6b service nova] Creating event network-vif-deleted:70141c5c-ab4f-4363-991b-b149f0bb880f for instance 68212561-7ed6-4c15-8807-b646d5c8fe24 on hv-cinder-82002 Sep 13 00:02:49.168112 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-b8f5a978-d5c9-4fd1-81ff-becf0cbaa197 req-b87d15a8-bf92-49d4-8e67-5c6227695e6b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036917 Sep 13 00:02:49.168714 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 435/874] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 13 00:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 00:02:49.200267 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0c598964-7148-4de7-8df5-f9b85dc275cc tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:02:49.201110 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0c598964-7148-4de7-8df5-f9b85dc275cc tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] [instance: 68212561-7ed6-4c15-8807-b646d5c8fe24] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:02:49.208499 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0c598964-7148-4de7-8df5-f9b85dc275cc tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:02:49.209084 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0c598964-7148-4de7-8df5-f9b85dc275cc tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:02:49.209651 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0c598964-7148-4de7-8df5-f9b85dc275cc tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:02:49.210716 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0c598964-7148-4de7-8df5-f9b85dc275cc tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:02:49.211242 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0c598964-7148-4de7-8df5-f9b85dc275cc tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:02:49.211817 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0c598964-7148-4de7-8df5-f9b85dc275cc tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:02:49.245946 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0c598964-7148-4de7-8df5-f9b85dc275cc tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:02:49.246424 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0c598964-7148-4de7-8df5-f9b85dc275cc tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:02:49.246856 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0c598964-7148-4de7-8df5-f9b85dc275cc tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:02:49.247322 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.objects.instance [None req-0c598964-7148-4de7-8df5-f9b85dc275cc tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lazy-loading 'fault' on Instance uuid 68212561-7ed6-4c15-8807-b646d5c8fe24 {{(pid=126975) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 00:02:49.294484 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0c598964-7148-4de7-8df5-f9b85dc275cc tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0236b1a2975247c9b325117f6918c80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed638ab95f4f21ad4bcc886adf0df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:02:49.304086 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0c598964-7148-4de7-8df5-f9b85dc275cc tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] 10.222.0.26 "GET /compute/v2.1/servers/68212561-7ed6-4c15-8807-b646d5c8fe24" status: 200 len: 1308 microversion: 2.1 time: 0.108827 Sep 13 00:02:49.305027 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 440/875] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:02:49 2022] GET /compute/v2.1/servers/68212561-7ed6-4c15-8807-b646d5c8fe24 => generated 1308 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:02:50.328348 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9a52a9de-78e0-4488-af59-2b41ce65d470 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:02:50.329032 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9a52a9de-78e0-4488-af59-2b41ce65d470 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] [instance: 68212561-7ed6-4c15-8807-b646d5c8fe24] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:02:50.336426 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9a52a9de-78e0-4488-af59-2b41ce65d470 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:02:50.336914 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9a52a9de-78e0-4488-af59-2b41ce65d470 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:02:50.337347 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9a52a9de-78e0-4488-af59-2b41ce65d470 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:02:50.338084 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9a52a9de-78e0-4488-af59-2b41ce65d470 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:02:50.338536 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9a52a9de-78e0-4488-af59-2b41ce65d470 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:02:50.338952 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9a52a9de-78e0-4488-af59-2b41ce65d470 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:02:50.353957 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-9a52a9de-78e0-4488-af59-2b41ce65d470 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] HTTP exception thrown: Instance 68212561-7ed6-4c15-8807-b646d5c8fe24 could not be found. Sep 13 00:02:50.355789 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9a52a9de-78e0-4488-af59-2b41ce65d470 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Request method failure captured: Sep 13 00:02:50.355789 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: request: GET /compute/v2.1/servers/68212561-7ed6-4c15-8807-b646d5c8fe24 HTTP/1.1 Sep 13 00:02:50.355789 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Accept: application/json Sep 13 00:02:50.355789 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Sep 13 00:02:50.355789 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Connection: close Sep 13 00:02:50.355789 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Content-Length: 0 Sep 13 00:02:50.355789 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Content-Type: application/json Sep 13 00:02:50.355789 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Host: 10.222.0.26 Sep 13 00:02:50.355789 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Sep 13 00:02:50.355789 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Sep 13 00:02:50.355789 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjH8hwrLZKeFvEwqkvjuSFqLH-CQnuA6beKsMU1nBg_SxeXcDBLGRYMnLn27-YiUGCX82rwG6jtb5HcTO2dtvqSI8cSc6RyrlTvFuo9-qBDzJkFOW0KYnSb8tBtJA2g0EuEzjNKt03_dsqNPsCIPlggOoQOm7GknVWjv_Cks9sPHj8NPY Sep 13 00:02:50.355789 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Sep 13 00:02:50.355789 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Sep 13 00:02:50.355789 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Sep 13 00:02:50.355789 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Sep 13 00:02:50.355789 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Sep 13 00:02:50.355789 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Sep 13 00:02:50.355789 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Id: 91ed638ab95f4f21ad4bcc886adf0df4 Sep 13 00:02:50.355789 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1135383017 Sep 13 00:02:50.355789 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Role: member,reader Sep 13 00:02:50.355789 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Roles: member,reader Sep 13 00:02:50.357522 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/91ed638ab95f4f21ad4bcc886adf0df4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/91ed638ab95f4f21ad4bcc886adf0df4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_91ed638ab95f4f21ad4bcc886adf0df4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/91ed638ab95f4f21ad4bcc886adf0df4"}]}] Sep 13 00:02:50.357522 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-VolumesSnapshotTestJSON-1135383017 Sep 13 00:02:50.357522 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant-Id: 91ed638ab95f4f21ad4bcc886adf0df4 Sep 13 00:02:50.357522 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1135383017 Sep 13 00:02:50.357522 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User: tempest-VolumesSnapshotTestJSON-1135383017-project Sep 13 00:02:50.357522 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Sep 13 00:02:50.357522 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Sep 13 00:02:50.357522 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Id: 0236b1a2975247c9b325117f6918c80e Sep 13 00:02:50.357522 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-VolumesSnapshotTestJSON-1135383017-project Sep 13 00:02:50.357522 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: method: > Sep 13 00:02:50.357522 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: exception: Instance 68212561-7ed6-4c15-8807-b646d5c8fe24 could not be found. Sep 13 00:02:50.357522 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: action_args: {'id': '68212561-7ed6-4c15-8807-b646d5c8fe24'} Sep 13 00:02:50.358638 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 00:02:50.358638 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:02:50.358638 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 00:02:50.358638 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 00:02:50.358638 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 00:02:50.358638 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 00:02:50.358638 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 00:02:50.358638 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 00:02:50.358638 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 00:02:50.358638 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 00:02:50.358638 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68212561-7ed6-4c15-8807-b646d5c8fe24 could not be found. Sep 13 00:02:50.358638 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:02:50.358638 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 00:02:50.358638 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:02:50.358638 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:02:50.358638 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 00:02:50.358638 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 00:02:50.358638 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 00:02:50.358638 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 00:02:50.358638 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 00:02:50.360213 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 00:02:50.360213 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 00:02:50.360213 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 00:02:50.360213 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 00:02:50.360213 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 00:02:50.360213 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 00:02:50.360213 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 00:02:50.360213 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68212561-7ed6-4c15-8807-b646d5c8fe24 could not be found. Sep 13 00:02:50.360213 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:02:50.360213 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 00:02:50.360213 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:02:50.360213 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:02:50.360213 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 00:02:50.360213 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 00:02:50.360213 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 00:02:50.360213 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 00:02:50.360213 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68212561-7ed6-4c15-8807-b646d5c8fe24 could not be found. Sep 13 00:02:50.360213 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:02:50.361495 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9a52a9de-78e0-4488-af59-2b41ce65d470 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Returning 404 to user: Instance 68212561-7ed6-4c15-8807-b646d5c8fe24 could not be found. {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 00:02:50.361495 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9a52a9de-78e0-4488-af59-2b41ce65d470 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] 10.222.0.26 "GET /compute/v2.1/servers/68212561-7ed6-4c15-8807-b646d5c8fe24" status: 404 len: 111 microversion: 2.1 time: 0.033281 Sep 13 00:02:50.361495 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 436/876] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:02:50 2022] GET /compute/v2.1/servers/68212561-7ed6-4c15-8807-b646d5c8fe24 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 00:03:00.345775 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c15aed3d-81c0-4bc1-bdba-fc9e4a6853fb tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-333788832", "imageRef": "22a47167-5e04-441a-a504-d76d82afc776", "flavorRef": "452", "networks": [{"uuid": "8f063293-b293-4d8e-a5d4-4190ebe90a2c"}]}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 00:03:00.354340 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell0:SELECT=4 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:03:00.355301 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:03:00.355971 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:03:00.512880 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.network.neutron [None req-c15aed3d-81c0-4bc1-bdba-fc9e4a6853fb tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] validate_networks() for [('8f063293-b293-4d8e-a5d4-4190ebe90a2c', None, None, None, None, None)] {{(pid=126975) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 00:03:00.883281 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-c15aed3d-81c0-4bc1-bdba-fc9e4a6853fb tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Flavor limits 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 00:03:00.883742 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-c15aed3d-81c0-4bc1-bdba-fc9e4a6853fb tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Image limits 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 00:03:00.884217 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-c15aed3d-81c0-4bc1-bdba-fc9e4a6853fb tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Flavor pref 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 00:03:00.884623 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-c15aed3d-81c0-4bc1-bdba-fc9e4a6853fb tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Image pref 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 00:03:00.885011 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-c15aed3d-81c0-4bc1-bdba-fc9e4a6853fb tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 00:03:00.895162 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c15aed3d-81c0-4bc1-bdba-fc9e4a6853fb tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:00.895653 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c15aed3d-81c0-4bc1-bdba-fc9e4a6853fb tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:00.896089 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c15aed3d-81c0-4bc1-bdba-fc9e4a6853fb tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:00.896824 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c15aed3d-81c0-4bc1-bdba-fc9e4a6853fb tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:00.897286 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c15aed3d-81c0-4bc1-bdba-fc9e4a6853fb tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:00.897710 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c15aed3d-81c0-4bc1-bdba-fc9e4a6853fb tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:00.915130 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-c15aed3d-81c0-4bc1-bdba-fc9e4a6853fb tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Getting quotas for project 91ed638ab95f4f21ad4bcc886adf0df4. Resources: {'instances', 'cores', 'ram'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 00:03:00.919703 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-c15aed3d-81c0-4bc1-bdba-fc9e4a6853fb tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Getting quotas for user 0236b1a2975247c9b325117f6918c80e and project 91ed638ab95f4f21ad4bcc886adf0df4. Resources: {'instances', 'cores', 'ram'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 00:03:00.932356 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c15aed3d-81c0-4bc1-bdba-fc9e4a6853fb tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Going to run 1 instances... {{(pid=126975) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 00:03:00.934686 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c15aed3d-81c0-4bc1-bdba-fc9e4a6853fb tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] [instance: bfcc20a9-031b-4426-bc83-94116252c775] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='22a47167-5e04-441a-a504-d76d82afc776',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=126975) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 00:03:00.984669 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c15aed3d-81c0-4bc1-bdba-fc9e4a6853fb tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.643032 Sep 13 00:03:00.985428 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 441/877] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Sep 13 00:03:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 00:03:00.996466 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9af9dbc2-ae7d-4737-8f9e-1573cad0d1ef tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:03:00.997083 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9af9dbc2-ae7d-4737-8f9e-1573cad0d1ef tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] [instance: bfcc20a9-031b-4426-bc83-94116252c775] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:03:00.999892 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=8 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:03:01.000752 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:03:01.163132 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-9af9dbc2-ae7d-4737-8f9e-1573cad0d1ef tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0236b1a2975247c9b325117f6918c80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed638ab95f4f21ad4bcc886adf0df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:03:01.170405 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9af9dbc2-ae7d-4737-8f9e-1573cad0d1ef tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] 10.222.0.26 "GET /compute/v2.1/servers/bfcc20a9-031b-4426-bc83-94116252c775" status: 200 len: 1218 microversion: 2.1 time: 0.177798 Sep 13 00:03:01.170946 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 437/878] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:03:00 2022] GET /compute/v2.1/servers/bfcc20a9-031b-4426-bc83-94116252c775 => generated 1218 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:03:02.194779 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-af54ac60-4b9c-4360-94df-70a7135707d2 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:03:02.195557 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-af54ac60-4b9c-4360-94df-70a7135707d2 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] [instance: bfcc20a9-031b-4426-bc83-94116252c775] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:03:02.203125 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-af54ac60-4b9c-4360-94df-70a7135707d2 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:02.203809 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-af54ac60-4b9c-4360-94df-70a7135707d2 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:02.204071 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-af54ac60-4b9c-4360-94df-70a7135707d2 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:02.204852 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-af54ac60-4b9c-4360-94df-70a7135707d2 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:02.205304 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-af54ac60-4b9c-4360-94df-70a7135707d2 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:02.205764 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-af54ac60-4b9c-4360-94df-70a7135707d2 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:02.290212 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-af54ac60-4b9c-4360-94df-70a7135707d2 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0236b1a2975247c9b325117f6918c80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed638ab95f4f21ad4bcc886adf0df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:03:02.297874 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-af54ac60-4b9c-4360-94df-70a7135707d2 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] 10.222.0.26 "GET /compute/v2.1/servers/bfcc20a9-031b-4426-bc83-94116252c775" status: 200 len: 1276 microversion: 2.1 time: 0.107729 Sep 13 00:03:02.298491 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 442/879] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:03:02 2022] GET /compute/v2.1/servers/bfcc20a9-031b-4426-bc83-94116252c775 => generated 1276 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 00:03:03.321152 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c15c9b1f-32ba-4aca-b5e1-260d01442d85 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:03:03.321766 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c15c9b1f-32ba-4aca-b5e1-260d01442d85 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] [instance: bfcc20a9-031b-4426-bc83-94116252c775] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:03:03.329156 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c15c9b1f-32ba-4aca-b5e1-260d01442d85 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:03.329636 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c15c9b1f-32ba-4aca-b5e1-260d01442d85 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:03.330064 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c15c9b1f-32ba-4aca-b5e1-260d01442d85 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:03.330756 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c15c9b1f-32ba-4aca-b5e1-260d01442d85 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:03.331201 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c15c9b1f-32ba-4aca-b5e1-260d01442d85 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:03.331648 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c15c9b1f-32ba-4aca-b5e1-260d01442d85 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:03.543622 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c15c9b1f-32ba-4aca-b5e1-260d01442d85 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0236b1a2975247c9b325117f6918c80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed638ab95f4f21ad4bcc886adf0df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:03:03.554398 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c15c9b1f-32ba-4aca-b5e1-260d01442d85 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] 10.222.0.26 "GET /compute/v2.1/servers/bfcc20a9-031b-4426-bc83-94116252c775" status: 200 len: 1318 microversion: 2.1 time: 0.237261 Sep 13 00:03:03.554986 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 438/880] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:03:03 2022] GET /compute/v2.1/servers/bfcc20a9-031b-4426-bc83-94116252c775 => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:03:03.593481 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-1230cd3f-d6fe-411b-b5b6-97b4473e27b4 req-763d799c-fd6b-49a0-a833-fc3acbb4ae2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfcc20a9-031b-4426-bc83-94116252c775", "tag": "ae112bdf-bb35-4ff2-9f50-a524541d3d07"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 00:03:03.604733 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-1230cd3f-d6fe-411b-b5b6-97b4473e27b4 req-763d799c-fd6b-49a0-a833-fc3acbb4ae2f service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:03.605293 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-1230cd3f-d6fe-411b-b5b6-97b4473e27b4 req-763d799c-fd6b-49a0-a833-fc3acbb4ae2f service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:03.605949 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-1230cd3f-d6fe-411b-b5b6-97b4473e27b4 req-763d799c-fd6b-49a0-a833-fc3acbb4ae2f service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:03.617865 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-1230cd3f-d6fe-411b-b5b6-97b4473e27b4 req-763d799c-fd6b-49a0-a833-fc3acbb4ae2f service nova] Creating event network-changed:ae112bdf-bb35-4ff2-9f50-a524541d3d07 for instance bfcc20a9-031b-4426-bc83-94116252c775 on hv-cinder-82002 Sep 13 00:03:03.623514 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-1230cd3f-d6fe-411b-b5b6-97b4473e27b4 req-763d799c-fd6b-49a0-a833-fc3acbb4ae2f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034381 Sep 13 00:03:03.624234 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 443/881] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 13 00:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 00:03:04.288317 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b61c1117-523d-47ea-bfa7-d76dcb718992 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-824719828", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1764420964", "security_groups": [{"name": "tempest-secgroup-smoke-479345869"}], "block_device_mapping_v2": [{"uuid": "08f5a1c9-954a-4a0b-a8b6-5ed90169f574", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "59fd1a5b-5d88-4e5e-aa91-1c1e68b4b584"}]}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 00:03:04.408927 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.network.neutron [None req-b61c1117-523d-47ea-bfa7-d76dcb718992 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] validate_networks() for [('59fd1a5b-5d88-4e5e-aa91-1c1e68b4b584', None, None, None, None, None)] {{(pid=126976) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 00:03:04.580709 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a1f49d03-c64b-4c9c-80b9-cb926e41d1dc tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:03:04.581558 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a1f49d03-c64b-4c9c-80b9-cb926e41d1dc tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] [instance: bfcc20a9-031b-4426-bc83-94116252c775] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:03:04.588811 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a1f49d03-c64b-4c9c-80b9-cb926e41d1dc tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:04.589304 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a1f49d03-c64b-4c9c-80b9-cb926e41d1dc tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:04.589738 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a1f49d03-c64b-4c9c-80b9-cb926e41d1dc tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:04.590435 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a1f49d03-c64b-4c9c-80b9-cb926e41d1dc tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:04.590890 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a1f49d03-c64b-4c9c-80b9-cb926e41d1dc tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:04.591341 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a1f49d03-c64b-4c9c-80b9-cb926e41d1dc tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:05.186391 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a1f49d03-c64b-4c9c-80b9-cb926e41d1dc tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0236b1a2975247c9b325117f6918c80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed638ab95f4f21ad4bcc886adf0df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:03:05.194959 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a1f49d03-c64b-4c9c-80b9-cb926e41d1dc tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] 10.222.0.26 "GET /compute/v2.1/servers/bfcc20a9-031b-4426-bc83-94116252c775" status: 200 len: 1318 microversion: 2.1 time: 0.620076 Sep 13 00:03:05.208344 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 444/882] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:03:04 2022] GET /compute/v2.1/servers/bfcc20a9-031b-4426-bc83-94116252c775 => generated 1318 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:03:05.254653 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-b61c1117-523d-47ea-bfa7-d76dcb718992 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Flavor limits 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 00:03:05.255075 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-b61c1117-523d-47ea-bfa7-d76dcb718992 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Image limits 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 00:03:05.255576 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-b61c1117-523d-47ea-bfa7-d76dcb718992 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Flavor pref 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 00:03:05.256119 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-b61c1117-523d-47ea-bfa7-d76dcb718992 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Image pref 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 00:03:05.256537 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-b61c1117-523d-47ea-bfa7-d76dcb718992 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 00:03:05.268941 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b61c1117-523d-47ea-bfa7-d76dcb718992 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:05.269610 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b61c1117-523d-47ea-bfa7-d76dcb718992 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:05.270220 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b61c1117-523d-47ea-bfa7-d76dcb718992 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:05.271132 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b61c1117-523d-47ea-bfa7-d76dcb718992 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:05.271748 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b61c1117-523d-47ea-bfa7-d76dcb718992 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:05.272220 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b61c1117-523d-47ea-bfa7-d76dcb718992 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:05.294383 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-b61c1117-523d-47ea-bfa7-d76dcb718992 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Getting quotas for project ecac3196aefa4c32994f85a86849c8c8. Resources: {'instances', 'cores', 'ram'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 00:03:05.298767 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-b61c1117-523d-47ea-bfa7-d76dcb718992 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Getting quotas for user f72b7cf8bf38477d8d6534eda6611982 and project ecac3196aefa4c32994f85a86849c8c8. Resources: {'instances', 'cores', 'ram'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 00:03:05.362311 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b61c1117-523d-47ea-bfa7-d76dcb718992 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Going to run 1 instances... {{(pid=126976) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 00:03:05.364748 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b61c1117-523d-47ea-bfa7-d76dcb718992 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: 3a76679f-7a4a-411e-afc4-747058b284a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='08f5a1c9-954a-4a0b-a8b6-5ed90169f574',volume_size=None,volume_type=None)] {{(pid=126976) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 00:03:05.516447 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b61c1117-523d-47ea-bfa7-d76dcb718992 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.232053 Sep 13 00:03:05.517146 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 439/883] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Sep 13 00:03:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 1233 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 00:03:05.528602 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-fc1b38f2-8824-43fe-ac51-0094cfe989e0 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:03:05.529221 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-fc1b38f2-8824-43fe-ac51-0094cfe989e0 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: 3a76679f-7a4a-411e-afc4-747058b284a6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:03:05.609672 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-fc1b38f2-8824-43fe-ac51-0094cfe989e0 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:03:05.617184 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-fc1b38f2-8824-43fe-ac51-0094cfe989e0 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6" status: 200 len: 1094 microversion: 2.1 time: 0.092437 Sep 13 00:03:05.627750 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 445/884] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:03:05 2022] GET /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6 => generated 1094 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:03:06.217775 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-41d26178-c595-42d1-8e47-6ec98a5b278d tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:03:06.218386 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-41d26178-c595-42d1-8e47-6ec98a5b278d tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] [instance: bfcc20a9-031b-4426-bc83-94116252c775] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:03:06.224654 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-41d26178-c595-42d1-8e47-6ec98a5b278d tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:06.225440 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-41d26178-c595-42d1-8e47-6ec98a5b278d tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:06.226065 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-41d26178-c595-42d1-8e47-6ec98a5b278d tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:06.226734 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-41d26178-c595-42d1-8e47-6ec98a5b278d tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:06.227179 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-41d26178-c595-42d1-8e47-6ec98a5b278d tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:06.227653 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-41d26178-c595-42d1-8e47-6ec98a5b278d tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:06.361855 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-41d26178-c595-42d1-8e47-6ec98a5b278d tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0236b1a2975247c9b325117f6918c80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed638ab95f4f21ad4bcc886adf0df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:03:06.369785 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-41d26178-c595-42d1-8e47-6ec98a5b278d tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] 10.222.0.26 "GET /compute/v2.1/servers/bfcc20a9-031b-4426-bc83-94116252c775" status: 200 len: 1318 microversion: 2.1 time: 0.155977 Sep 13 00:03:06.370414 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 440/885] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:03:06 2022] GET /compute/v2.1/servers/bfcc20a9-031b-4426-bc83-94116252c775 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:03:06.644017 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d93b011b-b88b-4c60-9337-2b0dbc68bc1c tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:03:06.644692 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d93b011b-b88b-4c60-9337-2b0dbc68bc1c tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: 3a76679f-7a4a-411e-afc4-747058b284a6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:03:06.654598 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d93b011b-b88b-4c60-9337-2b0dbc68bc1c tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:06.655101 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d93b011b-b88b-4c60-9337-2b0dbc68bc1c tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:06.655561 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d93b011b-b88b-4c60-9337-2b0dbc68bc1c tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:06.656271 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d93b011b-b88b-4c60-9337-2b0dbc68bc1c tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:06.656722 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d93b011b-b88b-4c60-9337-2b0dbc68bc1c tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:06.657141 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d93b011b-b88b-4c60-9337-2b0dbc68bc1c tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:06.734092 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d93b011b-b88b-4c60-9337-2b0dbc68bc1c tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:03:06.742323 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d93b011b-b88b-4c60-9337-2b0dbc68bc1c tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6" status: 200 len: 1200 microversion: 2.1 time: 0.102356 Sep 13 00:03:06.742899 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 446/886] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:03:06 2022] GET /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6 => generated 1200 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:03:07.393399 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-75c65746-9d5e-47f5-9395-d9587b381b86 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:03:07.394017 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-75c65746-9d5e-47f5-9395-d9587b381b86 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] [instance: bfcc20a9-031b-4426-bc83-94116252c775] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:03:07.414114 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-75c65746-9d5e-47f5-9395-d9587b381b86 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:07.414772 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-75c65746-9d5e-47f5-9395-d9587b381b86 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:07.415313 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-75c65746-9d5e-47f5-9395-d9587b381b86 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:07.416359 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-75c65746-9d5e-47f5-9395-d9587b381b86 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:07.416891 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-75c65746-9d5e-47f5-9395-d9587b381b86 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:07.417372 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-75c65746-9d5e-47f5-9395-d9587b381b86 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:07.648026 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-75c65746-9d5e-47f5-9395-d9587b381b86 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0236b1a2975247c9b325117f6918c80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed638ab95f4f21ad4bcc886adf0df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:03:07.659662 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-75c65746-9d5e-47f5-9395-d9587b381b86 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] 10.222.0.26 "GET /compute/v2.1/servers/bfcc20a9-031b-4426-bc83-94116252c775" status: 200 len: 1318 microversion: 2.1 time: 0.270517 Sep 13 00:03:07.660258 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 441/887] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:03:07 2022] GET /compute/v2.1/servers/bfcc20a9-031b-4426-bc83-94116252c775 => generated 1318 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:03:07.766816 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-05c3ecf6-88aa-4f5c-8952-7063abded3ed tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:03:07.767416 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-05c3ecf6-88aa-4f5c-8952-7063abded3ed tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: 3a76679f-7a4a-411e-afc4-747058b284a6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:03:07.774865 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-05c3ecf6-88aa-4f5c-8952-7063abded3ed tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:07.775363 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-05c3ecf6-88aa-4f5c-8952-7063abded3ed tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:07.775836 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-05c3ecf6-88aa-4f5c-8952-7063abded3ed tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:07.776567 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-05c3ecf6-88aa-4f5c-8952-7063abded3ed tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:07.779774 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-05c3ecf6-88aa-4f5c-8952-7063abded3ed tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:07.780211 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-05c3ecf6-88aa-4f5c-8952-7063abded3ed tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:07.915694 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-bd5337a1-fcfd-4d07-9392-26fd74166958 req-4e8bdd73-b8fc-4ddc-b87b-41a8ceee87c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfcc20a9-031b-4426-bc83-94116252c775", "name": "network-vif-plugged", "status": "completed", "tag": "ae112bdf-bb35-4ff2-9f50-a524541d3d07"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 00:03:07.927460 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-bd5337a1-fcfd-4d07-9392-26fd74166958 req-4e8bdd73-b8fc-4ddc-b87b-41a8ceee87c2 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:07.928099 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-bd5337a1-fcfd-4d07-9392-26fd74166958 req-4e8bdd73-b8fc-4ddc-b87b-41a8ceee87c2 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:07.928624 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-bd5337a1-fcfd-4d07-9392-26fd74166958 req-4e8bdd73-b8fc-4ddc-b87b-41a8ceee87c2 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:07.940529 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-bd5337a1-fcfd-4d07-9392-26fd74166958 req-4e8bdd73-b8fc-4ddc-b87b-41a8ceee87c2 service nova] Creating event network-vif-plugged:ae112bdf-bb35-4ff2-9f50-a524541d3d07 for instance bfcc20a9-031b-4426-bc83-94116252c775 on hv-cinder-82002 Sep 13 00:03:07.945997 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-bd5337a1-fcfd-4d07-9392-26fd74166958 req-4e8bdd73-b8fc-4ddc-b87b-41a8ceee87c2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034435 Sep 13 00:03:07.947060 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 442/888] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 13 00:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 00:03:08.000391 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-05c3ecf6-88aa-4f5c-8952-7063abded3ed tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:03:08.009653 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-05c3ecf6-88aa-4f5c-8952-7063abded3ed tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6" status: 200 len: 1265 microversion: 2.1 time: 0.247556 Sep 13 00:03:08.010385 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 447/889] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:03:07 2022] GET /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6 => generated 1265 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:03:08.445649 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-55154f4b-f6e4-41ed-abf2-7f8f59978307 req-3a2c460d-20cd-42c6-8738-350cce9c4ab0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a76679f-7a4a-411e-afc4-747058b284a6", "tag": "ffb7b293-10ca-46e8-a495-07036a735cac"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 00:03:08.455744 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-55154f4b-f6e4-41ed-abf2-7f8f59978307 req-3a2c460d-20cd-42c6-8738-350cce9c4ab0 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:08.456250 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-55154f4b-f6e4-41ed-abf2-7f8f59978307 req-3a2c460d-20cd-42c6-8738-350cce9c4ab0 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:08.456713 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-55154f4b-f6e4-41ed-abf2-7f8f59978307 req-3a2c460d-20cd-42c6-8738-350cce9c4ab0 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:08.467667 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-55154f4b-f6e4-41ed-abf2-7f8f59978307 req-3a2c460d-20cd-42c6-8738-350cce9c4ab0 service nova] Creating event network-changed:ffb7b293-10ca-46e8-a495-07036a735cac for instance 3a76679f-7a4a-411e-afc4-747058b284a6 on hv-cinder-82002 Sep 13 00:03:08.472390 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-55154f4b-f6e4-41ed-abf2-7f8f59978307 req-3a2c460d-20cd-42c6-8738-350cce9c4ab0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031462 Sep 13 00:03:08.473131 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 443/890] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 13 00:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 00:03:08.682786 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-171cf35e-c49e-41e5-bd8e-d4b0d85437ee tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:03:08.683459 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-171cf35e-c49e-41e5-bd8e-d4b0d85437ee tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] [instance: bfcc20a9-031b-4426-bc83-94116252c775] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:03:08.691229 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-171cf35e-c49e-41e5-bd8e-d4b0d85437ee tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:08.691857 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-171cf35e-c49e-41e5-bd8e-d4b0d85437ee tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:08.692550 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-171cf35e-c49e-41e5-bd8e-d4b0d85437ee tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:08.693646 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-171cf35e-c49e-41e5-bd8e-d4b0d85437ee tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:08.694099 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-171cf35e-c49e-41e5-bd8e-d4b0d85437ee tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:08.694522 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-171cf35e-c49e-41e5-bd8e-d4b0d85437ee tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:08.870781 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-171cf35e-c49e-41e5-bd8e-d4b0d85437ee tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0236b1a2975247c9b325117f6918c80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed638ab95f4f21ad4bcc886adf0df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:03:08.878631 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-171cf35e-c49e-41e5-bd8e-d4b0d85437ee tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] 10.222.0.26 "GET /compute/v2.1/servers/bfcc20a9-031b-4426-bc83-94116252c775" status: 200 len: 1318 microversion: 2.1 time: 0.200314 Sep 13 00:03:08.879189 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 448/891] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:03:08 2022] GET /compute/v2.1/servers/bfcc20a9-031b-4426-bc83-94116252c775 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:03:09.036406 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4f3e6a66-e341-40a8-93cc-7dbd15c886a0 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:03:09.037211 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-4f3e6a66-e341-40a8-93cc-7dbd15c886a0 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: 3a76679f-7a4a-411e-afc4-747058b284a6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:03:09.044087 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4f3e6a66-e341-40a8-93cc-7dbd15c886a0 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:09.044570 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4f3e6a66-e341-40a8-93cc-7dbd15c886a0 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:09.045001 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4f3e6a66-e341-40a8-93cc-7dbd15c886a0 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:09.045675 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4f3e6a66-e341-40a8-93cc-7dbd15c886a0 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:09.046131 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4f3e6a66-e341-40a8-93cc-7dbd15c886a0 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:09.046579 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4f3e6a66-e341-40a8-93cc-7dbd15c886a0 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:09.195565 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4f3e6a66-e341-40a8-93cc-7dbd15c886a0 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:03:09.204314 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-4f3e6a66-e341-40a8-93cc-7dbd15c886a0 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6" status: 200 len: 1265 microversion: 2.1 time: 0.172750 Sep 13 00:03:09.204855 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 444/892] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:03:09 2022] GET /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:03:09.900710 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-66e49db3-68af-4681-9c8d-2e7d5310226d tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:03:09.901332 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-66e49db3-68af-4681-9c8d-2e7d5310226d tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] [instance: bfcc20a9-031b-4426-bc83-94116252c775] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:03:09.908041 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-66e49db3-68af-4681-9c8d-2e7d5310226d tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:09.908530 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-66e49db3-68af-4681-9c8d-2e7d5310226d tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:09.908965 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-66e49db3-68af-4681-9c8d-2e7d5310226d tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:09.909671 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-66e49db3-68af-4681-9c8d-2e7d5310226d tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:09.910127 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-66e49db3-68af-4681-9c8d-2e7d5310226d tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:09.910551 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-66e49db3-68af-4681-9c8d-2e7d5310226d tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:10.045789 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-66e49db3-68af-4681-9c8d-2e7d5310226d tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0236b1a2975247c9b325117f6918c80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed638ab95f4f21ad4bcc886adf0df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:03:10.056484 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-66e49db3-68af-4681-9c8d-2e7d5310226d tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] 10.222.0.26 "GET /compute/v2.1/servers/bfcc20a9-031b-4426-bc83-94116252c775" status: 200 len: 1507 microversion: 2.1 time: 0.159563 Sep 13 00:03:10.057070 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 449/893] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:03:09 2022] GET /compute/v2.1/servers/bfcc20a9-031b-4426-bc83-94116252c775 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:03:10.081868 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-019ce4ca-4c09-4ae8-8f74-d1167b3063c2 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a715c568-525a-4d67-9041-e30835a8425e", "device": "/dev/sdb"}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 00:03:10.084274 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-019ce4ca-4c09-4ae8-8f74-d1167b3063c2 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] [instance: bfcc20a9-031b-4426-bc83-94116252c775] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:03:10.091192 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-019ce4ca-4c09-4ae8-8f74-d1167b3063c2 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:10.091896 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-019ce4ca-4c09-4ae8-8f74-d1167b3063c2 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:10.092146 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-019ce4ca-4c09-4ae8-8f74-d1167b3063c2 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:10.092839 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-019ce4ca-4c09-4ae8-8f74-d1167b3063c2 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:10.093348 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-019ce4ca-4c09-4ae8-8f74-d1167b3063c2 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:10.093774 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-019ce4ca-4c09-4ae8-8f74-d1167b3063c2 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:10.226339 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-6ca8bb6d-0061-4cb1-81f2-18867c9666cd tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:03:10.226943 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-6ca8bb6d-0061-4cb1-81f2-18867c9666cd tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: 3a76679f-7a4a-411e-afc4-747058b284a6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:03:10.233669 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6ca8bb6d-0061-4cb1-81f2-18867c9666cd tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:10.234304 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6ca8bb6d-0061-4cb1-81f2-18867c9666cd tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:10.234736 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6ca8bb6d-0061-4cb1-81f2-18867c9666cd tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:10.235626 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6ca8bb6d-0061-4cb1-81f2-18867c9666cd tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:10.236082 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6ca8bb6d-0061-4cb1-81f2-18867c9666cd tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:10.236707 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6ca8bb6d-0061-4cb1-81f2-18867c9666cd tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:10.358005 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-019ce4ca-4c09-4ae8-8f74-d1167b3063c2 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] 10.222.0.26 "POST /compute/v2.1/servers/bfcc20a9-031b-4426-bc83-94116252c775/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280421 Sep 13 00:03:10.358864 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 445/894] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Sep 13 00:03:10 2022] POST /compute/v2.1/servers/bfcc20a9-031b-4426-bc83-94116252c775/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 00:03:10.407400 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-6ca8bb6d-0061-4cb1-81f2-18867c9666cd tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:03:10.415353 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-6ca8bb6d-0061-4cb1-81f2-18867c9666cd tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6" status: 200 len: 1265 microversion: 2.1 time: 0.193158 Sep 13 00:03:10.416295 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 450/895] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:03:10 2022] GET /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6 => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 00:03:11.438941 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2be54b9c-62a0-48c9-8203-07d8cccb13ba tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:03:11.439695 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2be54b9c-62a0-48c9-8203-07d8cccb13ba tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: 3a76679f-7a4a-411e-afc4-747058b284a6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:03:11.446474 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2be54b9c-62a0-48c9-8203-07d8cccb13ba tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:11.446959 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2be54b9c-62a0-48c9-8203-07d8cccb13ba tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:11.447429 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2be54b9c-62a0-48c9-8203-07d8cccb13ba tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:11.448118 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2be54b9c-62a0-48c9-8203-07d8cccb13ba tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:11.448568 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2be54b9c-62a0-48c9-8203-07d8cccb13ba tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:11.448989 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2be54b9c-62a0-48c9-8203-07d8cccb13ba tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:11.597383 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2be54b9c-62a0-48c9-8203-07d8cccb13ba tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:03:11.605850 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2be54b9c-62a0-48c9-8203-07d8cccb13ba tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6" status: 200 len: 1265 microversion: 2.1 time: 0.171535 Sep 13 00:03:11.606442 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 446/896] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:03:11 2022] GET /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:03:12.628933 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5e03812c-241f-4ca8-88b7-3217f7fa4c00 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:03:12.629561 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5e03812c-241f-4ca8-88b7-3217f7fa4c00 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: 3a76679f-7a4a-411e-afc4-747058b284a6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:03:12.632035 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell0:SELECT=2 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:03:12.637807 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5e03812c-241f-4ca8-88b7-3217f7fa4c00 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:12.638278 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5e03812c-241f-4ca8-88b7-3217f7fa4c00 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:12.638721 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5e03812c-241f-4ca8-88b7-3217f7fa4c00 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:12.639890 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5e03812c-241f-4ca8-88b7-3217f7fa4c00 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:12.640351 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5e03812c-241f-4ca8-88b7-3217f7fa4c00 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:12.640774 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5e03812c-241f-4ca8-88b7-3217f7fa4c00 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:12.778246 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5e03812c-241f-4ca8-88b7-3217f7fa4c00 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:03:12.790507 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5e03812c-241f-4ca8-88b7-3217f7fa4c00 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6" status: 200 len: 1265 microversion: 2.1 time: 0.165384 Sep 13 00:03:12.791267 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 451/897] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:03:12 2022] GET /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:03:13.816870 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-167135bc-7492-4763-a89d-f57c44659c4d tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:03:13.817611 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-167135bc-7492-4763-a89d-f57c44659c4d tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: 3a76679f-7a4a-411e-afc4-747058b284a6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:03:13.825751 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-167135bc-7492-4763-a89d-f57c44659c4d tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:13.826244 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-167135bc-7492-4763-a89d-f57c44659c4d tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:13.826734 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-167135bc-7492-4763-a89d-f57c44659c4d tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:13.827544 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-167135bc-7492-4763-a89d-f57c44659c4d tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:13.828044 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-167135bc-7492-4763-a89d-f57c44659c4d tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:13.828468 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-167135bc-7492-4763-a89d-f57c44659c4d tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:13.963770 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-167135bc-7492-4763-a89d-f57c44659c4d tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:03:13.971700 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-167135bc-7492-4763-a89d-f57c44659c4d tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6" status: 200 len: 1265 microversion: 2.1 time: 0.160883 Sep 13 00:03:13.972248 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 447/898] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:03:13 2022] GET /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:03:14.994296 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-6becf733-d9de-44d4-b9f6-f8ba5f6a9161 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:03:14.994920 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-6becf733-d9de-44d4-b9f6-f8ba5f6a9161 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: 3a76679f-7a4a-411e-afc4-747058b284a6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:03:15.001713 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6becf733-d9de-44d4-b9f6-f8ba5f6a9161 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:15.002201 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6becf733-d9de-44d4-b9f6-f8ba5f6a9161 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:15.002635 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6becf733-d9de-44d4-b9f6-f8ba5f6a9161 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:15.003394 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6becf733-d9de-44d4-b9f6-f8ba5f6a9161 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:15.003850 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6becf733-d9de-44d4-b9f6-f8ba5f6a9161 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:15.004269 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6becf733-d9de-44d4-b9f6-f8ba5f6a9161 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:15.239992 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-6becf733-d9de-44d4-b9f6-f8ba5f6a9161 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:03:15.248622 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-6becf733-d9de-44d4-b9f6-f8ba5f6a9161 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6" status: 200 len: 1265 microversion: 2.1 time: 0.258329 Sep 13 00:03:15.249258 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 452/899] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:03:14 2022] GET /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6 => generated 1265 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:03:16.272652 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9e9e47a6-d81b-4ab4-aec6-c05438d621ea tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:03:16.273237 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9e9e47a6-d81b-4ab4-aec6-c05438d621ea tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: 3a76679f-7a4a-411e-afc4-747058b284a6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:03:16.275618 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell0:SELECT=2 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:03:16.276274 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell0:SELECT=8 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:03:16.283687 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9e9e47a6-d81b-4ab4-aec6-c05438d621ea tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:16.284270 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9e9e47a6-d81b-4ab4-aec6-c05438d621ea tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:16.284794 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9e9e47a6-d81b-4ab4-aec6-c05438d621ea tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:16.285719 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9e9e47a6-d81b-4ab4-aec6-c05438d621ea tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:16.286288 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9e9e47a6-d81b-4ab4-aec6-c05438d621ea tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:16.286809 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9e9e47a6-d81b-4ab4-aec6-c05438d621ea tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:16.425733 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-9e9e47a6-d81b-4ab4-aec6-c05438d621ea tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:03:16.434112 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9e9e47a6-d81b-4ab4-aec6-c05438d621ea tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6" status: 200 len: 1265 microversion: 2.1 time: 0.165535 Sep 13 00:03:16.434683 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 448/900] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:03:16 2022] GET /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:03:17.456903 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b42d5fee-9b46-4104-b031-cfbd9fcad97f tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:03:17.457499 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b42d5fee-9b46-4104-b031-cfbd9fcad97f tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: 3a76679f-7a4a-411e-afc4-747058b284a6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:03:17.459541 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell0:SELECT=8 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:03:17.465394 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b42d5fee-9b46-4104-b031-cfbd9fcad97f tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:17.465885 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b42d5fee-9b46-4104-b031-cfbd9fcad97f tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:17.466325 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b42d5fee-9b46-4104-b031-cfbd9fcad97f tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:17.467051 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b42d5fee-9b46-4104-b031-cfbd9fcad97f tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:17.467534 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b42d5fee-9b46-4104-b031-cfbd9fcad97f tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:17.467961 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b42d5fee-9b46-4104-b031-cfbd9fcad97f tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:17.620523 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b42d5fee-9b46-4104-b031-cfbd9fcad97f tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:03:17.629122 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b42d5fee-9b46-4104-b031-cfbd9fcad97f tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6" status: 200 len: 1265 microversion: 2.1 time: 0.176723 Sep 13 00:03:17.629697 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 453/901] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:03:17 2022] GET /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6 => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:03:18.653200 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-798d84f6-5509-4531-9d40-cd9be4555676 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:03:18.653816 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-798d84f6-5509-4531-9d40-cd9be4555676 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: 3a76679f-7a4a-411e-afc4-747058b284a6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:03:18.661295 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-798d84f6-5509-4531-9d40-cd9be4555676 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:18.661826 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-798d84f6-5509-4531-9d40-cd9be4555676 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:18.662262 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-798d84f6-5509-4531-9d40-cd9be4555676 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:18.662990 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-798d84f6-5509-4531-9d40-cd9be4555676 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:18.663482 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-798d84f6-5509-4531-9d40-cd9be4555676 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:18.663911 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-798d84f6-5509-4531-9d40-cd9be4555676 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:18.815012 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-798d84f6-5509-4531-9d40-cd9be4555676 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:03:18.823037 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-798d84f6-5509-4531-9d40-cd9be4555676 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6" status: 200 len: 1265 microversion: 2.1 time: 0.174258 Sep 13 00:03:18.823662 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 449/902] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:03:18 2022] GET /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:03:19.845864 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-fa07cbb7-defd-498c-9e98-b32700fa5ac8 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:03:19.846455 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-fa07cbb7-defd-498c-9e98-b32700fa5ac8 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: 3a76679f-7a4a-411e-afc4-747058b284a6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:03:19.855006 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fa07cbb7-defd-498c-9e98-b32700fa5ac8 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:19.855675 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fa07cbb7-defd-498c-9e98-b32700fa5ac8 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:19.856243 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fa07cbb7-defd-498c-9e98-b32700fa5ac8 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:19.857300 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fa07cbb7-defd-498c-9e98-b32700fa5ac8 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:19.857934 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fa07cbb7-defd-498c-9e98-b32700fa5ac8 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:19.858394 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fa07cbb7-defd-498c-9e98-b32700fa5ac8 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:20.013758 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-fa07cbb7-defd-498c-9e98-b32700fa5ac8 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:03:20.023483 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-fa07cbb7-defd-498c-9e98-b32700fa5ac8 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6" status: 200 len: 1265 microversion: 2.1 time: 0.181502 Sep 13 00:03:20.024071 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 454/903] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:03:19 2022] GET /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:03:21.047363 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-fb4420d2-33d4-47d1-ad00-43b4ae105dfb tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:03:21.048000 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-fb4420d2-33d4-47d1-ad00-43b4ae105dfb tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: 3a76679f-7a4a-411e-afc4-747058b284a6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:03:21.055356 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fb4420d2-33d4-47d1-ad00-43b4ae105dfb tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:21.055853 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fb4420d2-33d4-47d1-ad00-43b4ae105dfb tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:21.056277 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fb4420d2-33d4-47d1-ad00-43b4ae105dfb tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:21.057030 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fb4420d2-33d4-47d1-ad00-43b4ae105dfb tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:21.057475 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fb4420d2-33d4-47d1-ad00-43b4ae105dfb tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:21.057890 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fb4420d2-33d4-47d1-ad00-43b4ae105dfb tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:21.198794 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-fb4420d2-33d4-47d1-ad00-43b4ae105dfb tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:03:21.206731 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-fb4420d2-33d4-47d1-ad00-43b4ae105dfb tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6" status: 200 len: 1265 microversion: 2.1 time: 0.163342 Sep 13 00:03:21.207343 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 450/904] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:03:21 2022] GET /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:03:21.622143 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-fae53dd8-a638-4962-a58d-4ff9d3801c23 req-62dbd75c-b879-46b2-a5e6-e4f2d582b8ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a76679f-7a4a-411e-afc4-747058b284a6", "name": "network-vif-plugged", "status": "completed", "tag": "ffb7b293-10ca-46e8-a495-07036a735cac"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 00:03:21.632564 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-fae53dd8-a638-4962-a58d-4ff9d3801c23 req-62dbd75c-b879-46b2-a5e6-e4f2d582b8ec service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:21.633298 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-fae53dd8-a638-4962-a58d-4ff9d3801c23 req-62dbd75c-b879-46b2-a5e6-e4f2d582b8ec service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:21.633564 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-fae53dd8-a638-4962-a58d-4ff9d3801c23 req-62dbd75c-b879-46b2-a5e6-e4f2d582b8ec service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:21.645754 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-fae53dd8-a638-4962-a58d-4ff9d3801c23 req-62dbd75c-b879-46b2-a5e6-e4f2d582b8ec service nova] Creating event network-vif-plugged:ffb7b293-10ca-46e8-a495-07036a735cac for instance 3a76679f-7a4a-411e-afc4-747058b284a6 on hv-cinder-82002 Sep 13 00:03:21.650936 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-fae53dd8-a638-4962-a58d-4ff9d3801c23 req-62dbd75c-b879-46b2-a5e6-e4f2d582b8ec service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032744 Sep 13 00:03:21.651608 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 455/905] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 13 00:03:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 00:03:22.230157 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-9d5dbc38-ff6e-4f58-bf96-1fb9317a6a08 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:03:22.230697 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-9d5dbc38-ff6e-4f58-bf96-1fb9317a6a08 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: 3a76679f-7a4a-411e-afc4-747058b284a6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:03:22.238157 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9d5dbc38-ff6e-4f58-bf96-1fb9317a6a08 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:22.238381 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9d5dbc38-ff6e-4f58-bf96-1fb9317a6a08 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:22.238785 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9d5dbc38-ff6e-4f58-bf96-1fb9317a6a08 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:22.239596 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9d5dbc38-ff6e-4f58-bf96-1fb9317a6a08 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:22.239989 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9d5dbc38-ff6e-4f58-bf96-1fb9317a6a08 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:22.240387 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-9d5dbc38-ff6e-4f58-bf96-1fb9317a6a08 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:22.384719 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-9d5dbc38-ff6e-4f58-bf96-1fb9317a6a08 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:03:22.393016 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-9d5dbc38-ff6e-4f58-bf96-1fb9317a6a08 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6" status: 200 len: 1265 microversion: 2.1 time: 0.166931 Sep 13 00:03:22.393590 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 451/906] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:03:22 2022] GET /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:03:23.416942 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5780e1d7-5ffc-4068-93d6-5e0a24481cdc tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:03:23.417616 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5780e1d7-5ffc-4068-93d6-5e0a24481cdc tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: 3a76679f-7a4a-411e-afc4-747058b284a6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:03:23.424021 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5780e1d7-5ffc-4068-93d6-5e0a24481cdc tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:23.424514 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5780e1d7-5ffc-4068-93d6-5e0a24481cdc tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:23.424944 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5780e1d7-5ffc-4068-93d6-5e0a24481cdc tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:23.425639 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5780e1d7-5ffc-4068-93d6-5e0a24481cdc tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:23.426092 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5780e1d7-5ffc-4068-93d6-5e0a24481cdc tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:23.426512 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-5780e1d7-5ffc-4068-93d6-5e0a24481cdc tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:23.569205 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5780e1d7-5ffc-4068-93d6-5e0a24481cdc tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:03:23.577058 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5780e1d7-5ffc-4068-93d6-5e0a24481cdc tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6" status: 200 len: 1265 microversion: 2.1 time: 0.165152 Sep 13 00:03:23.577633 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 456/907] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:03:23 2022] GET /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:03:24.602588 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3e71c044-1abb-4e46-ad51-2c52177ba4bc tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:03:24.603509 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3e71c044-1abb-4e46-ad51-2c52177ba4bc tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: 3a76679f-7a4a-411e-afc4-747058b284a6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:03:24.610714 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e71c044-1abb-4e46-ad51-2c52177ba4bc tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:24.611204 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e71c044-1abb-4e46-ad51-2c52177ba4bc tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:24.611671 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e71c044-1abb-4e46-ad51-2c52177ba4bc tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:24.612372 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e71c044-1abb-4e46-ad51-2c52177ba4bc tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:24.612832 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e71c044-1abb-4e46-ad51-2c52177ba4bc tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:24.613256 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3e71c044-1abb-4e46-ad51-2c52177ba4bc tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:24.753356 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3e71c044-1abb-4e46-ad51-2c52177ba4bc tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:03:24.761746 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3e71c044-1abb-4e46-ad51-2c52177ba4bc tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6" status: 200 len: 1265 microversion: 2.1 time: 0.164650 Sep 13 00:03:24.762362 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 452/908] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:03:24 2022] GET /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:03:25.785447 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f3e89fd9-763f-4777-ba84-869e200967c7 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:03:25.786025 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f3e89fd9-763f-4777-ba84-869e200967c7 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: 3a76679f-7a4a-411e-afc4-747058b284a6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:03:25.792955 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f3e89fd9-763f-4777-ba84-869e200967c7 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:25.793438 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f3e89fd9-763f-4777-ba84-869e200967c7 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:25.793868 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f3e89fd9-763f-4777-ba84-869e200967c7 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:25.794558 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f3e89fd9-763f-4777-ba84-869e200967c7 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:25.795008 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f3e89fd9-763f-4777-ba84-869e200967c7 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:25.795474 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f3e89fd9-763f-4777-ba84-869e200967c7 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:25.934440 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f3e89fd9-763f-4777-ba84-869e200967c7 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:03:25.943651 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f3e89fd9-763f-4777-ba84-869e200967c7 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6" status: 200 len: 1265 microversion: 2.1 time: 0.161685 Sep 13 00:03:25.944406 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 457/909] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:03:25 2022] GET /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:03:26.973934 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-a88be8bc-09b3-4f9d-9584-c0fa2ea12ee3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:03:26.974560 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-a88be8bc-09b3-4f9d-9584-c0fa2ea12ee3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: 3a76679f-7a4a-411e-afc4-747058b284a6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:03:26.981571 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a88be8bc-09b3-4f9d-9584-c0fa2ea12ee3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:26.982062 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a88be8bc-09b3-4f9d-9584-c0fa2ea12ee3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:26.982499 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a88be8bc-09b3-4f9d-9584-c0fa2ea12ee3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:26.983203 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a88be8bc-09b3-4f9d-9584-c0fa2ea12ee3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:26.983696 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a88be8bc-09b3-4f9d-9584-c0fa2ea12ee3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:26.984122 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-a88be8bc-09b3-4f9d-9584-c0fa2ea12ee3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:27.134824 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-a88be8bc-09b3-4f9d-9584-c0fa2ea12ee3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:03:27.144341 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-a88be8bc-09b3-4f9d-9584-c0fa2ea12ee3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6" status: 200 len: 1451 microversion: 2.1 time: 0.174367 Sep 13 00:03:27.144919 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 453/910] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:03:26 2022] GET /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6 => generated 1451 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:03:27.175155 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-db5bd505-1807-45f3-bc3f-67f7d02a2e30 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:03:27.175832 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-db5bd505-1807-45f3-bc3f-67f7d02a2e30 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: 3a76679f-7a4a-411e-afc4-747058b284a6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:03:27.182630 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-db5bd505-1807-45f3-bc3f-67f7d02a2e30 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:27.183135 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-db5bd505-1807-45f3-bc3f-67f7d02a2e30 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:27.183624 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-db5bd505-1807-45f3-bc3f-67f7d02a2e30 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:27.184327 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-db5bd505-1807-45f3-bc3f-67f7d02a2e30 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:27.184783 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-db5bd505-1807-45f3-bc3f-67f7d02a2e30 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:27.185202 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-db5bd505-1807-45f3-bc3f-67f7d02a2e30 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:27.332248 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-db5bd505-1807-45f3-bc3f-67f7d02a2e30 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:03:27.340341 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-db5bd505-1807-45f3-bc3f-67f7d02a2e30 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6" status: 200 len: 1451 microversion: 2.1 time: 0.168958 Sep 13 00:03:27.340892 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 458/911] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:03:27 2022] GET /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6 => generated 1451 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:03:29.360635 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-0d7e3160-a54c-4fda-9994-34609aa10e45 req-c7e199c8-eaba-4adb-ad72-7b71b45a5642 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a76679f-7a4a-411e-afc4-747058b284a6", "tag": "ffb7b293-10ca-46e8-a495-07036a735cac"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 00:03:29.374137 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-0d7e3160-a54c-4fda-9994-34609aa10e45 req-c7e199c8-eaba-4adb-ad72-7b71b45a5642 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:29.374137 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-0d7e3160-a54c-4fda-9994-34609aa10e45 req-c7e199c8-eaba-4adb-ad72-7b71b45a5642 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:29.374137 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-0d7e3160-a54c-4fda-9994-34609aa10e45 req-c7e199c8-eaba-4adb-ad72-7b71b45a5642 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:29.383420 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-0d7e3160-a54c-4fda-9994-34609aa10e45 req-c7e199c8-eaba-4adb-ad72-7b71b45a5642 service nova] Creating event network-changed:ffb7b293-10ca-46e8-a495-07036a735cac for instance 3a76679f-7a4a-411e-afc4-747058b284a6 on hv-cinder-82002 Sep 13 00:03:29.388917 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-0d7e3160-a54c-4fda-9994-34609aa10e45 req-c7e199c8-eaba-4adb-ad72-7b71b45a5642 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032295 Sep 13 00:03:29.390126 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 454/912] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 13 00:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 00:03:29.836809 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7e1b2d63-8626-4ad1-be99-93c51f95b2e8 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:03:29.837332 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7e1b2d63-8626-4ad1-be99-93c51f95b2e8 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] [instance: bfcc20a9-031b-4426-bc83-94116252c775] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:03:29.844499 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7e1b2d63-8626-4ad1-be99-93c51f95b2e8 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:29.845315 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7e1b2d63-8626-4ad1-be99-93c51f95b2e8 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:29.845900 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7e1b2d63-8626-4ad1-be99-93c51f95b2e8 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:29.846747 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7e1b2d63-8626-4ad1-be99-93c51f95b2e8 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:29.847382 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7e1b2d63-8626-4ad1-be99-93c51f95b2e8 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:29.847987 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7e1b2d63-8626-4ad1-be99-93c51f95b2e8 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:29.939521 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.objects.instance [None req-7e1b2d63-8626-4ad1-be99-93c51f95b2e8 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lazy-loading 'services' on Instance uuid bfcc20a9-031b-4426-bc83-94116252c775 {{(pid=126975) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 00:03:30.007037 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:03:30.019393 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7e1b2d63-8626-4ad1-be99-93c51f95b2e8 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] 10.222.0.26 "DELETE /compute/v2.1/servers/bfcc20a9-031b-4426-bc83-94116252c775/os-volume_attachments/a715c568-525a-4d67-9041-e30835a8425e" status: 202 len: 0 microversion: 2.1 time: 0.186974 Sep 13 00:03:30.020088 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 459/913] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Sep 13 00:03:29 2022] DELETE /compute/v2.1/servers/bfcc20a9-031b-4426-bc83-94116252c775/os-volume_attachments/a715c568-525a-4d67-9041-e30835a8425e => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 00:03:31.174109 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-129acf52-11eb-4531-9569-9e2f4545b838 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:03:31.174755 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-129acf52-11eb-4531-9569-9e2f4545b838 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] [instance: bfcc20a9-031b-4426-bc83-94116252c775] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:03:31.178216 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:03:31.185845 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-129acf52-11eb-4531-9569-9e2f4545b838 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:31.186325 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-129acf52-11eb-4531-9569-9e2f4545b838 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:31.186763 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-129acf52-11eb-4531-9569-9e2f4545b838 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:31.187488 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-129acf52-11eb-4531-9569-9e2f4545b838 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:31.187941 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-129acf52-11eb-4531-9569-9e2f4545b838 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:31.188364 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-129acf52-11eb-4531-9569-9e2f4545b838 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:31.191869 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:03:31.219170 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-129acf52-11eb-4531-9569-9e2f4545b838 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] [instance: bfcc20a9-031b-4426-bc83-94116252c775] Going to try to terminate instance {{(pid=126976) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 00:03:31.301031 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-129acf52-11eb-4531-9569-9e2f4545b838 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] 10.222.0.26 "DELETE /compute/v2.1/servers/bfcc20a9-031b-4426-bc83-94116252c775" status: 204 len: 0 microversion: 2.1 time: 0.132824 Sep 13 00:03:31.301654 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 455/914] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Sep 13 00:03:31 2022] DELETE /compute/v2.1/servers/bfcc20a9-031b-4426-bc83-94116252c775 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 00:03:31.310859 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-63fe6ce2-3d06-49e4-9616-7c2e4acb8041 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:03:31.311597 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-63fe6ce2-3d06-49e4-9616-7c2e4acb8041 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] [instance: bfcc20a9-031b-4426-bc83-94116252c775] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:03:31.314316 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:03:31.320247 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-63fe6ce2-3d06-49e4-9616-7c2e4acb8041 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:31.320669 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-63fe6ce2-3d06-49e4-9616-7c2e4acb8041 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:31.321106 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-63fe6ce2-3d06-49e4-9616-7c2e4acb8041 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:31.321806 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-63fe6ce2-3d06-49e4-9616-7c2e4acb8041 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:31.322259 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-63fe6ce2-3d06-49e4-9616-7c2e4acb8041 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:31.322680 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-63fe6ce2-3d06-49e4-9616-7c2e4acb8041 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:31.462512 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-63fe6ce2-3d06-49e4-9616-7c2e4acb8041 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0236b1a2975247c9b325117f6918c80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed638ab95f4f21ad4bcc886adf0df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:03:31.474903 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-63fe6ce2-3d06-49e4-9616-7c2e4acb8041 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] 10.222.0.26 "GET /compute/v2.1/servers/bfcc20a9-031b-4426-bc83-94116252c775" status: 200 len: 1513 microversion: 2.1 time: 0.168072 Sep 13 00:03:31.475693 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 460/915] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:03:31 2022] GET /compute/v2.1/servers/bfcc20a9-031b-4426-bc83-94116252c775 => generated 1513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:03:32.500032 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-fe9c7a61-a209-43e2-b411-4e26fb412c11 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:03:32.500735 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-fe9c7a61-a209-43e2-b411-4e26fb412c11 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] [instance: bfcc20a9-031b-4426-bc83-94116252c775] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:03:32.507578 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fe9c7a61-a209-43e2-b411-4e26fb412c11 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:32.508063 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fe9c7a61-a209-43e2-b411-4e26fb412c11 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:32.508497 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fe9c7a61-a209-43e2-b411-4e26fb412c11 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:32.509175 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fe9c7a61-a209-43e2-b411-4e26fb412c11 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:32.509622 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fe9c7a61-a209-43e2-b411-4e26fb412c11 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:32.510060 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fe9c7a61-a209-43e2-b411-4e26fb412c11 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:32.654300 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-fe9c7a61-a209-43e2-b411-4e26fb412c11 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0236b1a2975247c9b325117f6918c80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed638ab95f4f21ad4bcc886adf0df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:03:32.664799 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-fe9c7a61-a209-43e2-b411-4e26fb412c11 tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] 10.222.0.26 "GET /compute/v2.1/servers/bfcc20a9-031b-4426-bc83-94116252c775" status: 200 len: 1513 microversion: 2.1 time: 0.169178 Sep 13 00:03:32.665317 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 456/916] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:03:32 2022] GET /compute/v2.1/servers/bfcc20a9-031b-4426-bc83-94116252c775 => generated 1513 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:03:33.604205 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-480eb13e-2b59-4fb2-ba7d-4f95a6392411 req-6ba6fcb5-67fb-47d4-88fc-419d1fe75324 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfcc20a9-031b-4426-bc83-94116252c775", "name": "network-vif-deleted", "tag": "ae112bdf-bb35-4ff2-9f50-a524541d3d07"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 00:03:33.617989 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-480eb13e-2b59-4fb2-ba7d-4f95a6392411 req-6ba6fcb5-67fb-47d4-88fc-419d1fe75324 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:33.618473 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-480eb13e-2b59-4fb2-ba7d-4f95a6392411 req-6ba6fcb5-67fb-47d4-88fc-419d1fe75324 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:33.618885 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-480eb13e-2b59-4fb2-ba7d-4f95a6392411 req-6ba6fcb5-67fb-47d4-88fc-419d1fe75324 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:33.631942 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-480eb13e-2b59-4fb2-ba7d-4f95a6392411 req-6ba6fcb5-67fb-47d4-88fc-419d1fe75324 service nova] Creating event network-vif-deleted:ae112bdf-bb35-4ff2-9f50-a524541d3d07 for instance bfcc20a9-031b-4426-bc83-94116252c775 on hv-cinder-82002 Sep 13 00:03:33.637084 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-480eb13e-2b59-4fb2-ba7d-4f95a6392411 req-6ba6fcb5-67fb-47d4-88fc-419d1fe75324 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036722 Sep 13 00:03:33.637681 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 461/917] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 13 00:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 00:03:33.689395 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-4b848f63-a61e-4d56-ad89-33036b25f17f tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:03:33.690020 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-4b848f63-a61e-4d56-ad89-33036b25f17f tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] [instance: bfcc20a9-031b-4426-bc83-94116252c775] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:03:33.697394 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4b848f63-a61e-4d56-ad89-33036b25f17f tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:33.697876 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4b848f63-a61e-4d56-ad89-33036b25f17f tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:33.698312 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4b848f63-a61e-4d56-ad89-33036b25f17f tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:33.699489 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4b848f63-a61e-4d56-ad89-33036b25f17f tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:33.699945 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4b848f63-a61e-4d56-ad89-33036b25f17f tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:33.700552 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4b848f63-a61e-4d56-ad89-33036b25f17f tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:33.737262 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4b848f63-a61e-4d56-ad89-33036b25f17f tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:33.737757 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4b848f63-a61e-4d56-ad89-33036b25f17f tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:33.738194 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-4b848f63-a61e-4d56-ad89-33036b25f17f tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:33.738645 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.objects.instance [None req-4b848f63-a61e-4d56-ad89-33036b25f17f tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lazy-loading 'fault' on Instance uuid bfcc20a9-031b-4426-bc83-94116252c775 {{(pid=126976) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 00:03:33.782324 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-4b848f63-a61e-4d56-ad89-33036b25f17f tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0236b1a2975247c9b325117f6918c80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91ed638ab95f4f21ad4bcc886adf0df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:03:33.792269 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-4b848f63-a61e-4d56-ad89-33036b25f17f tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] 10.222.0.26 "GET /compute/v2.1/servers/bfcc20a9-031b-4426-bc83-94116252c775" status: 200 len: 1308 microversion: 2.1 time: 0.107030 Sep 13 00:03:33.792855 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 457/918] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:03:33 2022] GET /compute/v2.1/servers/bfcc20a9-031b-4426-bc83-94116252c775 => generated 1308 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:03:34.817400 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-29aa712f-516d-448e-b252-fbeed668d29e tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:03:34.818098 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-29aa712f-516d-448e-b252-fbeed668d29e tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] [instance: bfcc20a9-031b-4426-bc83-94116252c775] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:03:34.825507 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-29aa712f-516d-448e-b252-fbeed668d29e tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:34.825987 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-29aa712f-516d-448e-b252-fbeed668d29e tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:34.826432 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-29aa712f-516d-448e-b252-fbeed668d29e tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:34.827076 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-29aa712f-516d-448e-b252-fbeed668d29e tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:03:34.827569 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-29aa712f-516d-448e-b252-fbeed668d29e tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:03:34.827991 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-29aa712f-516d-448e-b252-fbeed668d29e tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:03:34.842422 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-29aa712f-516d-448e-b252-fbeed668d29e tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] HTTP exception thrown: Instance bfcc20a9-031b-4426-bc83-94116252c775 could not be found. Sep 13 00:03:34.844146 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-29aa712f-516d-448e-b252-fbeed668d29e tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Request method failure captured: Sep 13 00:03:34.844146 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: request: GET /compute/v2.1/servers/bfcc20a9-031b-4426-bc83-94116252c775 HTTP/1.1 Sep 13 00:03:34.844146 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept: application/json Sep 13 00:03:34.844146 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Sep 13 00:03:34.844146 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Connection: close Sep 13 00:03:34.844146 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Length: 0 Sep 13 00:03:34.844146 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Type: application/json Sep 13 00:03:34.844146 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Host: 10.222.0.26 Sep 13 00:03:34.844146 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Sep 13 00:03:34.844146 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Sep 13 00:03:34.844146 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjH8hwrLZKeFvEwqkvjuSFqLH-CQnuA6beKsMU1nBg_SxeXcDBLGRYMnLn27-YiUGCX82rwG6jtb5HcTO2dtvqSI8cSc6RyrlTvFuo9-qBDzJkFOW0KYnSb8tBtJA2g0EuEzjNKt03_dsqNPsCIPlggOoQOm7GknVWjv_Cks9sPHj8NPY Sep 13 00:03:34.844146 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Sep 13 00:03:34.844146 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Sep 13 00:03:34.844146 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Sep 13 00:03:34.844146 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Sep 13 00:03:34.844146 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Sep 13 00:03:34.844146 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Sep 13 00:03:34.844146 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Id: 91ed638ab95f4f21ad4bcc886adf0df4 Sep 13 00:03:34.844146 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1135383017 Sep 13 00:03:34.844146 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Role: member,reader Sep 13 00:03:34.844146 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Roles: member,reader Sep 13 00:03:34.845885 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/91ed638ab95f4f21ad4bcc886adf0df4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/91ed638ab95f4f21ad4bcc886adf0df4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_91ed638ab95f4f21ad4bcc886adf0df4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/91ed638ab95f4f21ad4bcc886adf0df4"}]}] Sep 13 00:03:34.845885 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-VolumesSnapshotTestJSON-1135383017 Sep 13 00:03:34.845885 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Id: 91ed638ab95f4f21ad4bcc886adf0df4 Sep 13 00:03:34.845885 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1135383017 Sep 13 00:03:34.845885 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User: tempest-VolumesSnapshotTestJSON-1135383017-project Sep 13 00:03:34.845885 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Sep 13 00:03:34.845885 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Sep 13 00:03:34.845885 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Id: 0236b1a2975247c9b325117f6918c80e Sep 13 00:03:34.845885 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-VolumesSnapshotTestJSON-1135383017-project Sep 13 00:03:34.845885 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: method: > Sep 13 00:03:34.845885 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: exception: Instance bfcc20a9-031b-4426-bc83-94116252c775 could not be found. Sep 13 00:03:34.845885 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: action_args: {'id': 'bfcc20a9-031b-4426-bc83-94116252c775'} Sep 13 00:03:34.846867 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 00:03:34.846867 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:03:34.846867 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 00:03:34.846867 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 00:03:34.846867 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 00:03:34.846867 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 00:03:34.846867 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 00:03:34.846867 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 00:03:34.846867 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 00:03:34.846867 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 00:03:34.846867 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfcc20a9-031b-4426-bc83-94116252c775 could not be found. Sep 13 00:03:34.846867 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:03:34.846867 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 00:03:34.846867 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:03:34.846867 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:03:34.846867 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 00:03:34.846867 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 00:03:34.846867 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 00:03:34.846867 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 00:03:34.846867 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 00:03:34.848550 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 00:03:34.848550 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 00:03:34.848550 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 00:03:34.848550 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 00:03:34.848550 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 00:03:34.848550 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 00:03:34.848550 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 00:03:34.848550 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfcc20a9-031b-4426-bc83-94116252c775 could not be found. Sep 13 00:03:34.848550 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:03:34.848550 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 00:03:34.848550 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:03:34.848550 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:03:34.848550 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 00:03:34.848550 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 00:03:34.848550 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 00:03:34.848550 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 00:03:34.848550 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfcc20a9-031b-4426-bc83-94116252c775 could not be found. Sep 13 00:03:34.848550 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:03:34.849928 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-29aa712f-516d-448e-b252-fbeed668d29e tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] Returning 404 to user: Instance bfcc20a9-031b-4426-bc83-94116252c775 could not be found. {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 00:03:34.849928 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-29aa712f-516d-448e-b252-fbeed668d29e tempest-VolumesSnapshotTestJSON-1135383017 tempest-VolumesSnapshotTestJSON-1135383017-project] 10.222.0.26 "GET /compute/v2.1/servers/bfcc20a9-031b-4426-bc83-94116252c775" status: 404 len: 111 microversion: 2.1 time: 0.032541 Sep 13 00:03:34.849928 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 462/919] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:03:34 2022] GET /compute/v2.1/servers/bfcc20a9-031b-4426-bc83-94116252c775 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 00:04:07.756861 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 00:04:07.757527 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Tue Sep 13 00:04:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.26) !!! Sep 13 00:04:07.758218 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:04:07.758943 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:04:07.963455 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f54dea29-e172-45b8-983d-cc3a956dccbb tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Action: 'create', calling method: .version_select at 0x7fed0120caf0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1882983442", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK8VmaTjzkek4vLddmadvM13Sfw9KCb0bqa4xYG2vNphDZg0k0x3HCPInsvxTx5tUUXRFLUOVKxtt+w07V6Tofr63LVIldVlVpZ5YJ857/Tx5GJb1A/G4kr4JJDFp4W8iw=="}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 00:04:07.980197 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-f54dea29-e172-45b8-983d-cc3a956dccbb tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Getting quotas for project 07b62652571943b58f9c8bd4c1ee9931. Resources: {'key_pairs'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 00:04:07.984662 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-f54dea29-e172-45b8-983d-cc3a956dccbb tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Getting quotas for user fb103e002840445db31703e141cf3a66 and project 07b62652571943b58f9c8bd4c1ee9931. Resources: {'key_pairs'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 00:04:08.015126 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f54dea29-e172-45b8-983d-cc3a956dccbb tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.264485 Sep 13 00:04:08.015768 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 458/920] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Sep 13 00:04:07 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 00:04:25.429543 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8566e07c-7d74-4857-bc79-fd5950b0d202 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1391385195", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1882983442", "security_groups": [{"name": "tempest-secgroup-smoke-265569184"}], "networks": [{"uuid": "dc1c8caa-bc70-4151-bd30-211506e0b7e6"}], "block_device_mapping_v2": [{"uuid": "e1e4e4bf-1569-44a4-b0cd-afddef612333", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 00:04:25.445341 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=5 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:04:25.445747 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=10 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:04:25.571369 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.network.neutron [None req-8566e07c-7d74-4857-bc79-fd5950b0d202 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] validate_networks() for [('dc1c8caa-bc70-4151-bd30-211506e0b7e6', None, None, None, None, None)] {{(pid=126975) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 00:04:26.025620 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-8566e07c-7d74-4857-bc79-fd5950b0d202 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Flavor limits 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 00:04:26.026268 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-8566e07c-7d74-4857-bc79-fd5950b0d202 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Image limits 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 00:04:26.026990 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-8566e07c-7d74-4857-bc79-fd5950b0d202 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Flavor pref 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 00:04:26.027598 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-8566e07c-7d74-4857-bc79-fd5950b0d202 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Image pref 0:0:0 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 00:04:26.028388 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.virt.hardware [None req-8566e07c-7d74-4857-bc79-fd5950b0d202 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126975) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 00:04:26.038191 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8566e07c-7d74-4857-bc79-fd5950b0d202 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:04:26.038673 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8566e07c-7d74-4857-bc79-fd5950b0d202 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:04:26.039115 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8566e07c-7d74-4857-bc79-fd5950b0d202 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:04:26.039871 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8566e07c-7d74-4857-bc79-fd5950b0d202 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:04:26.040368 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8566e07c-7d74-4857-bc79-fd5950b0d202 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:04:26.040790 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8566e07c-7d74-4857-bc79-fd5950b0d202 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:04:26.058231 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-8566e07c-7d74-4857-bc79-fd5950b0d202 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Getting quotas for project 07b62652571943b58f9c8bd4c1ee9931. Resources: {'instances', 'cores', 'ram'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 00:04:26.063523 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.quota [None req-8566e07c-7d74-4857-bc79-fd5950b0d202 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Getting quotas for user fb103e002840445db31703e141cf3a66 and project 07b62652571943b58f9c8bd4c1ee9931. Resources: {'instances', 'cores', 'ram'} {{(pid=126975) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 00:04:26.126906 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8566e07c-7d74-4857-bc79-fd5950b0d202 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Going to run 1 instances... {{(pid=126975) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 00:04:26.130173 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8566e07c-7d74-4857-bc79-fd5950b0d202 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] [instance: 5a30688a-8c79-425d-9679-0b15397e2c2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e1e4e4bf-1569-44a4-b0cd-afddef612333',volume_size=None,volume_type=None)] {{(pid=126975) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 00:04:26.268924 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8566e07c-7d74-4857-bc79-fd5950b0d202 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.849207 Sep 13 00:04:26.269549 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 463/921] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Sep 13 00:04:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 851 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 00:04:26.281706 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-5800ebc9-172a-43f5-aaaa-74629e479fdd tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:04:26.282322 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-5800ebc9-172a-43f5-aaaa-74629e479fdd tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] [instance: 5a30688a-8c79-425d-9679-0b15397e2c2b] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:04:26.285744 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell0:SELECT=4 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:04:26.286784 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:04:26.345509 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-5800ebc9-172a-43f5-aaaa-74629e479fdd tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb103e002840445db31703e141cf3a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b62652571943b58f9c8bd4c1ee9931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:04:26.352741 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-5800ebc9-172a-43f5-aaaa-74629e479fdd tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] 10.222.0.26 "GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b" status: 200 len: 1089 microversion: 2.1 time: 0.074832 Sep 13 00:04:26.353336 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 459/922] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:04:26 2022] GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b => generated 1089 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:04:27.376639 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-da69577f-7e9a-4863-822c-4a30880535fc tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:04:27.377188 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-da69577f-7e9a-4863-822c-4a30880535fc tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] [instance: 5a30688a-8c79-425d-9679-0b15397e2c2b] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:04:27.383955 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-da69577f-7e9a-4863-822c-4a30880535fc tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:04:27.384441 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-da69577f-7e9a-4863-822c-4a30880535fc tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:04:27.384986 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-da69577f-7e9a-4863-822c-4a30880535fc tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:04:27.385685 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-da69577f-7e9a-4863-822c-4a30880535fc tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:04:27.386301 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-da69577f-7e9a-4863-822c-4a30880535fc tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:04:27.386727 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-da69577f-7e9a-4863-822c-4a30880535fc tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:04:27.449990 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-da69577f-7e9a-4863-822c-4a30880535fc tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb103e002840445db31703e141cf3a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b62652571943b58f9c8bd4c1ee9931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:04:27.459197 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-da69577f-7e9a-4863-822c-4a30880535fc tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] 10.222.0.26 "GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b" status: 200 len: 1187 microversion: 2.1 time: 0.087559 Sep 13 00:04:27.459829 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 464/923] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:04:27 2022] GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b => generated 1187 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:04:28.485562 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3b0266da-e00e-4ca5-9e40-f83645325696 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:04:28.486656 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3b0266da-e00e-4ca5-9e40-f83645325696 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] [instance: 5a30688a-8c79-425d-9679-0b15397e2c2b] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:04:28.495912 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3b0266da-e00e-4ca5-9e40-f83645325696 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:04:28.496347 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3b0266da-e00e-4ca5-9e40-f83645325696 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:04:28.496784 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3b0266da-e00e-4ca5-9e40-f83645325696 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:04:28.497502 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3b0266da-e00e-4ca5-9e40-f83645325696 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:04:28.497957 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3b0266da-e00e-4ca5-9e40-f83645325696 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:04:28.498383 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3b0266da-e00e-4ca5-9e40-f83645325696 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:04:28.743601 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3b0266da-e00e-4ca5-9e40-f83645325696 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb103e002840445db31703e141cf3a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b62652571943b58f9c8bd4c1ee9931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:04:28.751916 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3b0266da-e00e-4ca5-9e40-f83645325696 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] 10.222.0.26 "GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b" status: 200 len: 1260 microversion: 2.1 time: 0.270328 Sep 13 00:04:28.752450 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 460/924] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:04:28 2022] GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b => generated 1260 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:04:29.206724 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-b250ef73-4a68-4f17-9570-4f53e4fccb97 req-579f7fab-cc43-44c3-8a17-14d3c60e2152 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a30688a-8c79-425d-9679-0b15397e2c2b", "tag": "e1cee19c-d5a9-45b9-bc59-8bd3e6eaf9cb"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 00:04:29.216154 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-b250ef73-4a68-4f17-9570-4f53e4fccb97 req-579f7fab-cc43-44c3-8a17-14d3c60e2152 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:04:29.216622 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-b250ef73-4a68-4f17-9570-4f53e4fccb97 req-579f7fab-cc43-44c3-8a17-14d3c60e2152 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:04:29.217035 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-b250ef73-4a68-4f17-9570-4f53e4fccb97 req-579f7fab-cc43-44c3-8a17-14d3c60e2152 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:04:29.227975 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-b250ef73-4a68-4f17-9570-4f53e4fccb97 req-579f7fab-cc43-44c3-8a17-14d3c60e2152 service nova] Creating event network-changed:e1cee19c-d5a9-45b9-bc59-8bd3e6eaf9cb for instance 5a30688a-8c79-425d-9679-0b15397e2c2b on hv-cinder-82002 Sep 13 00:04:29.232974 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-b250ef73-4a68-4f17-9570-4f53e4fccb97 req-579f7fab-cc43-44c3-8a17-14d3c60e2152 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098073 Sep 13 00:04:29.233568 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 465/925] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 13 00:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 00:04:29.775937 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-35db3ed4-3239-403d-bce0-cc05e335f0f3 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:04:29.776495 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-35db3ed4-3239-403d-bce0-cc05e335f0f3 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] [instance: 5a30688a-8c79-425d-9679-0b15397e2c2b] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:04:29.783488 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-35db3ed4-3239-403d-bce0-cc05e335f0f3 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:04:29.783975 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-35db3ed4-3239-403d-bce0-cc05e335f0f3 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:04:29.784410 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-35db3ed4-3239-403d-bce0-cc05e335f0f3 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:04:29.785109 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-35db3ed4-3239-403d-bce0-cc05e335f0f3 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:04:29.785566 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-35db3ed4-3239-403d-bce0-cc05e335f0f3 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:04:29.785987 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-35db3ed4-3239-403d-bce0-cc05e335f0f3 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:04:30.006270 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-35db3ed4-3239-403d-bce0-cc05e335f0f3 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb103e002840445db31703e141cf3a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b62652571943b58f9c8bd4c1ee9931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:04:30.014867 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-35db3ed4-3239-403d-bce0-cc05e335f0f3 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] 10.222.0.26 "GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b" status: 200 len: 1260 microversion: 2.1 time: 0.242940 Sep 13 00:04:30.015484 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 461/926] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:04:29 2022] GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b => generated 1260 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:04:31.044111 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9b453a67-b6e4-4435-8691-4d6b29934af0 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:04:31.045147 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9b453a67-b6e4-4435-8691-4d6b29934af0 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] [instance: 5a30688a-8c79-425d-9679-0b15397e2c2b] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:04:31.055788 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9b453a67-b6e4-4435-8691-4d6b29934af0 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:04:31.056598 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9b453a67-b6e4-4435-8691-4d6b29934af0 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:04:31.057329 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9b453a67-b6e4-4435-8691-4d6b29934af0 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:04:31.058483 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9b453a67-b6e4-4435-8691-4d6b29934af0 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:04:31.059303 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9b453a67-b6e4-4435-8691-4d6b29934af0 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:04:31.059955 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9b453a67-b6e4-4435-8691-4d6b29934af0 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:04:31.207475 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9b453a67-b6e4-4435-8691-4d6b29934af0 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb103e002840445db31703e141cf3a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b62652571943b58f9c8bd4c1ee9931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:04:31.215434 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9b453a67-b6e4-4435-8691-4d6b29934af0 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] 10.222.0.26 "GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b" status: 200 len: 1260 microversion: 2.1 time: 0.179353 Sep 13 00:04:31.216037 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 466/927] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:04:31 2022] GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b => generated 1260 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:04:32.240290 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b77c8e76-3dcb-44cd-bedb-9962ff68c85c tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:04:32.241105 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b77c8e76-3dcb-44cd-bedb-9962ff68c85c tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] [instance: 5a30688a-8c79-425d-9679-0b15397e2c2b] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:04:32.250855 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b77c8e76-3dcb-44cd-bedb-9962ff68c85c tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:04:32.251712 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b77c8e76-3dcb-44cd-bedb-9962ff68c85c tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:04:32.252419 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b77c8e76-3dcb-44cd-bedb-9962ff68c85c tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:04:32.253528 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b77c8e76-3dcb-44cd-bedb-9962ff68c85c tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:04:32.254273 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b77c8e76-3dcb-44cd-bedb-9962ff68c85c tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:04:32.254872 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b77c8e76-3dcb-44cd-bedb-9962ff68c85c tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:04:32.406493 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b77c8e76-3dcb-44cd-bedb-9962ff68c85c tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb103e002840445db31703e141cf3a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b62652571943b58f9c8bd4c1ee9931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:04:32.417718 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b77c8e76-3dcb-44cd-bedb-9962ff68c85c tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] 10.222.0.26 "GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b" status: 200 len: 1260 microversion: 2.1 time: 0.182521 Sep 13 00:04:32.418430 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 462/928] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:04:32 2022] GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b => generated 1260 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:04:33.441075 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-55b67ae6-244e-481e-9ada-576aefa39efe tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:04:33.441656 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-55b67ae6-244e-481e-9ada-576aefa39efe tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] [instance: 5a30688a-8c79-425d-9679-0b15397e2c2b] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:04:33.448857 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-55b67ae6-244e-481e-9ada-576aefa39efe tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:04:33.449345 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-55b67ae6-244e-481e-9ada-576aefa39efe tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:04:33.449781 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-55b67ae6-244e-481e-9ada-576aefa39efe tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:04:33.450614 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-55b67ae6-244e-481e-9ada-576aefa39efe tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:04:33.451068 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-55b67ae6-244e-481e-9ada-576aefa39efe tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:04:33.451515 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-55b67ae6-244e-481e-9ada-576aefa39efe tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:04:33.592183 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-55b67ae6-244e-481e-9ada-576aefa39efe tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb103e002840445db31703e141cf3a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b62652571943b58f9c8bd4c1ee9931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:04:33.600173 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-55b67ae6-244e-481e-9ada-576aefa39efe tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] 10.222.0.26 "GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b" status: 200 len: 1260 microversion: 2.1 time: 0.163161 Sep 13 00:04:33.600744 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 467/929] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:04:33 2022] GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:04:34.625590 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3d1e68d9-9eed-4345-8cd1-ed2bd6ac721f tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:04:34.626346 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3d1e68d9-9eed-4345-8cd1-ed2bd6ac721f tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] [instance: 5a30688a-8c79-425d-9679-0b15397e2c2b] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:04:34.635983 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3d1e68d9-9eed-4345-8cd1-ed2bd6ac721f tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:04:34.636619 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3d1e68d9-9eed-4345-8cd1-ed2bd6ac721f tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:04:34.637261 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3d1e68d9-9eed-4345-8cd1-ed2bd6ac721f tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:04:34.638314 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3d1e68d9-9eed-4345-8cd1-ed2bd6ac721f tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:04:34.638775 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3d1e68d9-9eed-4345-8cd1-ed2bd6ac721f tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:04:34.639566 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3d1e68d9-9eed-4345-8cd1-ed2bd6ac721f tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:04:34.793801 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3d1e68d9-9eed-4345-8cd1-ed2bd6ac721f tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb103e002840445db31703e141cf3a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b62652571943b58f9c8bd4c1ee9931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:04:34.806061 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3d1e68d9-9eed-4345-8cd1-ed2bd6ac721f tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] 10.222.0.26 "GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b" status: 200 len: 1260 microversion: 2.1 time: 0.186100 Sep 13 00:04:34.806990 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 463/930] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:04:34 2022] GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b => generated 1260 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:04:35.830319 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a3978053-ad6a-483c-b0a9-d6769548447f tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:04:35.830936 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a3978053-ad6a-483c-b0a9-d6769548447f tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] [instance: 5a30688a-8c79-425d-9679-0b15397e2c2b] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:04:35.839076 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a3978053-ad6a-483c-b0a9-d6769548447f tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:04:35.839587 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a3978053-ad6a-483c-b0a9-d6769548447f tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:04:35.840020 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a3978053-ad6a-483c-b0a9-d6769548447f tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:04:35.841042 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a3978053-ad6a-483c-b0a9-d6769548447f tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:04:35.841598 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a3978053-ad6a-483c-b0a9-d6769548447f tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:04:35.842012 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a3978053-ad6a-483c-b0a9-d6769548447f tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:04:35.977476 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a3978053-ad6a-483c-b0a9-d6769548447f tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb103e002840445db31703e141cf3a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b62652571943b58f9c8bd4c1ee9931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:04:35.985471 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a3978053-ad6a-483c-b0a9-d6769548447f tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] 10.222.0.26 "GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b" status: 200 len: 1260 microversion: 2.1 time: 0.159182 Sep 13 00:04:35.986050 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 468/931] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:04:35 2022] GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:04:37.011858 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e7f2e9e5-491d-487c-81d3-457e82ccfb7d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:04:37.012532 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e7f2e9e5-491d-487c-81d3-457e82ccfb7d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] [instance: 5a30688a-8c79-425d-9679-0b15397e2c2b] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:04:37.016412 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell0:SELECT=2 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:04:37.024580 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e7f2e9e5-491d-487c-81d3-457e82ccfb7d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:04:37.025295 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e7f2e9e5-491d-487c-81d3-457e82ccfb7d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:04:37.025953 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e7f2e9e5-491d-487c-81d3-457e82ccfb7d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:04:37.026969 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e7f2e9e5-491d-487c-81d3-457e82ccfb7d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:04:37.027706 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e7f2e9e5-491d-487c-81d3-457e82ccfb7d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:04:37.028313 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e7f2e9e5-491d-487c-81d3-457e82ccfb7d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:04:37.166569 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e7f2e9e5-491d-487c-81d3-457e82ccfb7d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb103e002840445db31703e141cf3a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b62652571943b58f9c8bd4c1ee9931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:04:37.176496 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e7f2e9e5-491d-487c-81d3-457e82ccfb7d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] 10.222.0.26 "GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b" status: 200 len: 1260 microversion: 2.1 time: 0.170670 Sep 13 00:04:37.177099 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 464/932] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:04:37 2022] GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:04:37.944390 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell0:SELECT=2 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:04:37.945429 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell0:SELECT=6 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:04:38.004855 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-aa4f7c57-7dc2-43dc-9b0e-413ed1a23775 req-21b13019-a687-499a-9810-8ef79e0a3f65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a30688a-8c79-425d-9679-0b15397e2c2b", "name": "network-vif-plugged", "status": "completed", "tag": "e1cee19c-d5a9-45b9-bc59-8bd3e6eaf9cb"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 00:04:38.015500 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-aa4f7c57-7dc2-43dc-9b0e-413ed1a23775 req-21b13019-a687-499a-9810-8ef79e0a3f65 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:04:38.015981 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-aa4f7c57-7dc2-43dc-9b0e-413ed1a23775 req-21b13019-a687-499a-9810-8ef79e0a3f65 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:04:38.016398 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-aa4f7c57-7dc2-43dc-9b0e-413ed1a23775 req-21b13019-a687-499a-9810-8ef79e0a3f65 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:04:38.027425 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-aa4f7c57-7dc2-43dc-9b0e-413ed1a23775 req-21b13019-a687-499a-9810-8ef79e0a3f65 service nova] Creating event network-vif-plugged:e1cee19c-d5a9-45b9-bc59-8bd3e6eaf9cb for instance 5a30688a-8c79-425d-9679-0b15397e2c2b on hv-cinder-82002 Sep 13 00:04:38.032626 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-aa4f7c57-7dc2-43dc-9b0e-413ed1a23775 req-21b13019-a687-499a-9810-8ef79e0a3f65 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092692 Sep 13 00:04:38.033198 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 469/933] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 13 00:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 00:04:38.203151 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3fb4bcb9-8151-4ab8-aae6-d38cebd37538 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:04:38.203896 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3fb4bcb9-8151-4ab8-aae6-d38cebd37538 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] [instance: 5a30688a-8c79-425d-9679-0b15397e2c2b] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:04:38.210861 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3fb4bcb9-8151-4ab8-aae6-d38cebd37538 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:04:38.211383 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3fb4bcb9-8151-4ab8-aae6-d38cebd37538 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:04:38.211816 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3fb4bcb9-8151-4ab8-aae6-d38cebd37538 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:04:38.212517 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3fb4bcb9-8151-4ab8-aae6-d38cebd37538 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:04:38.212969 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3fb4bcb9-8151-4ab8-aae6-d38cebd37538 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:04:38.213776 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3fb4bcb9-8151-4ab8-aae6-d38cebd37538 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:04:38.410061 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3fb4bcb9-8151-4ab8-aae6-d38cebd37538 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb103e002840445db31703e141cf3a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b62652571943b58f9c8bd4c1ee9931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:04:38.421822 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3fb4bcb9-8151-4ab8-aae6-d38cebd37538 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] 10.222.0.26 "GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b" status: 200 len: 1260 microversion: 2.1 time: 0.222765 Sep 13 00:04:38.422408 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 465/934] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:04:38 2022] GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b => generated 1260 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:04:39.448795 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-b153952b-ce81-4159-abcb-2c33f0f29e54 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:04:39.449382 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-b153952b-ce81-4159-abcb-2c33f0f29e54 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] [instance: 5a30688a-8c79-425d-9679-0b15397e2c2b] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:04:39.459680 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b153952b-ce81-4159-abcb-2c33f0f29e54 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:04:39.460335 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b153952b-ce81-4159-abcb-2c33f0f29e54 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:04:39.460953 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b153952b-ce81-4159-abcb-2c33f0f29e54 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:04:39.461931 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b153952b-ce81-4159-abcb-2c33f0f29e54 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:04:39.462494 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b153952b-ce81-4159-abcb-2c33f0f29e54 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:04:39.463065 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-b153952b-ce81-4159-abcb-2c33f0f29e54 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:04:39.599799 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-b153952b-ce81-4159-abcb-2c33f0f29e54 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb103e002840445db31703e141cf3a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b62652571943b58f9c8bd4c1ee9931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:04:39.608614 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-b153952b-ce81-4159-abcb-2c33f0f29e54 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] 10.222.0.26 "GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b" status: 200 len: 1260 microversion: 2.1 time: 0.167027 Sep 13 00:04:39.609060 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 470/935] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:04:39 2022] GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:04:40.631487 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f9116ec0-345d-4915-9d31-a19baa555406 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:04:40.632116 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f9116ec0-345d-4915-9d31-a19baa555406 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] [instance: 5a30688a-8c79-425d-9679-0b15397e2c2b] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:04:40.639731 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f9116ec0-345d-4915-9d31-a19baa555406 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:04:40.640218 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f9116ec0-345d-4915-9d31-a19baa555406 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:04:40.640653 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f9116ec0-345d-4915-9d31-a19baa555406 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:04:40.641344 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f9116ec0-345d-4915-9d31-a19baa555406 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:04:40.641796 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f9116ec0-345d-4915-9d31-a19baa555406 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:04:40.642217 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f9116ec0-345d-4915-9d31-a19baa555406 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:04:40.797872 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f9116ec0-345d-4915-9d31-a19baa555406 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb103e002840445db31703e141cf3a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b62652571943b58f9c8bd4c1ee9931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:04:40.806244 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f9116ec0-345d-4915-9d31-a19baa555406 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] 10.222.0.26 "GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b" status: 200 len: 1443 microversion: 2.1 time: 0.178785 Sep 13 00:04:40.806813 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 466/936] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:04:40 2022] GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b => generated 1443 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:04:40.828312 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0af11ded-0111-4603-a09a-651f82e2ca87 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:04:40.828870 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0af11ded-0111-4603-a09a-651f82e2ca87 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] [instance: 5a30688a-8c79-425d-9679-0b15397e2c2b] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:04:40.835969 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0af11ded-0111-4603-a09a-651f82e2ca87 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:04:40.836478 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0af11ded-0111-4603-a09a-651f82e2ca87 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:04:40.836881 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0af11ded-0111-4603-a09a-651f82e2ca87 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:04:40.837789 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0af11ded-0111-4603-a09a-651f82e2ca87 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:04:40.838259 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0af11ded-0111-4603-a09a-651f82e2ca87 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:04:40.838719 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0af11ded-0111-4603-a09a-651f82e2ca87 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:04:40.972881 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0af11ded-0111-4603-a09a-651f82e2ca87 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb103e002840445db31703e141cf3a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b62652571943b58f9c8bd4c1ee9931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:04:40.981068 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0af11ded-0111-4603-a09a-651f82e2ca87 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] 10.222.0.26 "GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b" status: 200 len: 1443 microversion: 2.1 time: 0.156645 Sep 13 00:04:40.981653 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 471/937] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:04:40 2022] GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b => generated 1443 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:04:42.976848 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-f3d4f173-de0a-4ad2-a162-8639a258d82b req-478609d4-1b4c-4304-8817-7e76839477f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a30688a-8c79-425d-9679-0b15397e2c2b", "tag": "e1cee19c-d5a9-45b9-bc59-8bd3e6eaf9cb"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 00:04:42.988004 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-f3d4f173-de0a-4ad2-a162-8639a258d82b req-478609d4-1b4c-4304-8817-7e76839477f2 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:04:42.988491 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-f3d4f173-de0a-4ad2-a162-8639a258d82b req-478609d4-1b4c-4304-8817-7e76839477f2 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:04:42.988920 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-f3d4f173-de0a-4ad2-a162-8639a258d82b req-478609d4-1b4c-4304-8817-7e76839477f2 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:04:43.001423 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-f3d4f173-de0a-4ad2-a162-8639a258d82b req-478609d4-1b4c-4304-8817-7e76839477f2 service nova] Creating event network-changed:e1cee19c-d5a9-45b9-bc59-8bd3e6eaf9cb for instance 5a30688a-8c79-425d-9679-0b15397e2c2b on hv-cinder-82002 Sep 13 00:04:43.006879 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-f3d4f173-de0a-4ad2-a162-8639a258d82b req-478609d4-1b4c-4304-8817-7e76839477f2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033788 Sep 13 00:04:43.007607 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 467/938] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 13 00:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 00:05:27.719070 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2d4139a5-ee84-4e97-ac1a-bb43a488da22 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:05:27.719789 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2d4139a5-ee84-4e97-ac1a-bb43a488da22 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: 3a76679f-7a4a-411e-afc4-747058b284a6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:05:27.722225 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:05:27.722813 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=42 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:05:27.723657 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 00:05:27.723842 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Tue Sep 13 00:05:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6 (ip 10.222.0.26) !!! Sep 13 00:05:27.732495 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2d4139a5-ee84-4e97-ac1a-bb43a488da22 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:05:27.733007 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2d4139a5-ee84-4e97-ac1a-bb43a488da22 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:05:27.733456 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2d4139a5-ee84-4e97-ac1a-bb43a488da22 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:05:27.734158 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2d4139a5-ee84-4e97-ac1a-bb43a488da22 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:05:27.734609 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2d4139a5-ee84-4e97-ac1a-bb43a488da22 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:05:27.735027 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2d4139a5-ee84-4e97-ac1a-bb43a488da22 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:05:27.769084 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2d4139a5-ee84-4e97-ac1a-bb43a488da22 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: 3a76679f-7a4a-411e-afc4-747058b284a6] Going to try to terminate instance {{(pid=126975) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 00:05:27.860075 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2d4139a5-ee84-4e97-ac1a-bb43a488da22 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6" status: 204 len: 0 microversion: 2.1 time: 0.146579 Sep 13 00:05:27.860843 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 472/939] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Sep 13 00:05:27 2022] DELETE /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 00:05:27.868579 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=20 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:05:27.869300 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=44 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:05:27.870444 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 00:05:27.870616 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Tue Sep 13 00:05:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6 (ip 10.222.0.26) !!! Sep 13 00:05:27.876948 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3eb42b26-3a68-4990-8035-4bcc11fc2aa9 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:05:27.877654 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3eb42b26-3a68-4990-8035-4bcc11fc2aa9 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: 3a76679f-7a4a-411e-afc4-747058b284a6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:05:27.890847 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3eb42b26-3a68-4990-8035-4bcc11fc2aa9 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:05:27.891381 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3eb42b26-3a68-4990-8035-4bcc11fc2aa9 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:05:27.892019 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3eb42b26-3a68-4990-8035-4bcc11fc2aa9 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:05:27.892730 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3eb42b26-3a68-4990-8035-4bcc11fc2aa9 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:05:27.893175 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3eb42b26-3a68-4990-8035-4bcc11fc2aa9 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:05:27.893597 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3eb42b26-3a68-4990-8035-4bcc11fc2aa9 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:05:28.044761 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3eb42b26-3a68-4990-8035-4bcc11fc2aa9 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:05:28.053314 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3eb42b26-3a68-4990-8035-4bcc11fc2aa9 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6" status: 200 len: 1576 microversion: 2.1 time: 0.186677 Sep 13 00:05:28.053876 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 468/940] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:05:27 2022] GET /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6 => generated 1576 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:05:29.078274 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8ce1c056-5be5-4c7a-86c5-5262d6d11c4c tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:05:29.079006 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8ce1c056-5be5-4c7a-86c5-5262d6d11c4c tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: 3a76679f-7a4a-411e-afc4-747058b284a6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:05:29.086142 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8ce1c056-5be5-4c7a-86c5-5262d6d11c4c tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:05:29.086630 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8ce1c056-5be5-4c7a-86c5-5262d6d11c4c tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:05:29.087063 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8ce1c056-5be5-4c7a-86c5-5262d6d11c4c tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:05:29.087831 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8ce1c056-5be5-4c7a-86c5-5262d6d11c4c tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:05:29.088299 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8ce1c056-5be5-4c7a-86c5-5262d6d11c4c tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:05:29.088718 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8ce1c056-5be5-4c7a-86c5-5262d6d11c4c tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:05:29.240078 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8ce1c056-5be5-4c7a-86c5-5262d6d11c4c tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:05:29.249217 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8ce1c056-5be5-4c7a-86c5-5262d6d11c4c tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6" status: 200 len: 1576 microversion: 2.1 time: 0.175310 Sep 13 00:05:29.249850 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 473/941] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:05:29 2022] GET /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6 => generated 1576 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:05:30.273886 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-66c1a03d-c0c6-43c9-a21e-36bccd917605 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:05:30.275326 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-66c1a03d-c0c6-43c9-a21e-36bccd917605 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: 3a76679f-7a4a-411e-afc4-747058b284a6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:05:30.282442 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-66c1a03d-c0c6-43c9-a21e-36bccd917605 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:05:30.282943 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-66c1a03d-c0c6-43c9-a21e-36bccd917605 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:05:30.283403 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-66c1a03d-c0c6-43c9-a21e-36bccd917605 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:05:30.284120 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-66c1a03d-c0c6-43c9-a21e-36bccd917605 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:05:30.284601 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-66c1a03d-c0c6-43c9-a21e-36bccd917605 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:05:30.285161 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-66c1a03d-c0c6-43c9-a21e-36bccd917605 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:05:30.376871 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-66c1a03d-c0c6-43c9-a21e-36bccd917605 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:05:30.385462 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-66c1a03d-c0c6-43c9-a21e-36bccd917605 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6" status: 200 len: 1509 microversion: 2.1 time: 0.115772 Sep 13 00:05:30.386388 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 469/942] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:05:30 2022] GET /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6 => generated 1509 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:05:30.593980 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-a29ebd79-3170-40b5-9f7e-5982f127c8d1 req-ab60db25-4ee1-4954-b600-63daa6f2a66b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a76679f-7a4a-411e-afc4-747058b284a6", "name": "network-vif-deleted", "tag": "ffb7b293-10ca-46e8-a495-07036a735cac"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 00:05:30.612470 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-a29ebd79-3170-40b5-9f7e-5982f127c8d1 req-ab60db25-4ee1-4954-b600-63daa6f2a66b service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:05:30.613825 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-a29ebd79-3170-40b5-9f7e-5982f127c8d1 req-ab60db25-4ee1-4954-b600-63daa6f2a66b service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:05:30.614885 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-a29ebd79-3170-40b5-9f7e-5982f127c8d1 req-ab60db25-4ee1-4954-b600-63daa6f2a66b service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:05:30.641499 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-a29ebd79-3170-40b5-9f7e-5982f127c8d1 req-ab60db25-4ee1-4954-b600-63daa6f2a66b service nova] Creating event network-vif-deleted:ffb7b293-10ca-46e8-a495-07036a735cac for instance 3a76679f-7a4a-411e-afc4-747058b284a6 on hv-cinder-82002 Sep 13 00:05:30.650016 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-a29ebd79-3170-40b5-9f7e-5982f127c8d1 req-ab60db25-4ee1-4954-b600-63daa6f2a66b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064342 Sep 13 00:05:30.652134 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 474/943] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 13 00:05:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 00:05:31.409076 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2da52b3d-9e98-441e-86c6-ac733369f611 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:05:31.409675 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2da52b3d-9e98-441e-86c6-ac733369f611 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: 3a76679f-7a4a-411e-afc4-747058b284a6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:05:31.417627 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2da52b3d-9e98-441e-86c6-ac733369f611 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:05:31.418386 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2da52b3d-9e98-441e-86c6-ac733369f611 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:05:31.418602 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2da52b3d-9e98-441e-86c6-ac733369f611 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:05:31.419419 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2da52b3d-9e98-441e-86c6-ac733369f611 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:05:31.419898 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2da52b3d-9e98-441e-86c6-ac733369f611 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:05:31.420498 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2da52b3d-9e98-441e-86c6-ac733369f611 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:05:31.462931 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2da52b3d-9e98-441e-86c6-ac733369f611 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:05:31.463656 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2da52b3d-9e98-441e-86c6-ac733369f611 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:05:31.463952 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2da52b3d-9e98-441e-86c6-ac733369f611 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:05:31.464418 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.objects.instance [None req-2da52b3d-9e98-441e-86c6-ac733369f611 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lazy-loading 'fault' on Instance uuid 3a76679f-7a4a-411e-afc4-747058b284a6 {{(pid=126976) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 00:05:31.517573 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2da52b3d-9e98-441e-86c6-ac733369f611 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:05:31.527082 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2da52b3d-9e98-441e-86c6-ac733369f611 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6" status: 200 len: 1230 microversion: 2.1 time: 0.121819 Sep 13 00:05:31.528659 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 470/944] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:05:31 2022] GET /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6 => generated 1230 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:05:32.552702 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-79939fe0-1922-4f0f-8a8a-8b530193a95c tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:05:32.553274 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-79939fe0-1922-4f0f-8a8a-8b530193a95c tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: 3a76679f-7a4a-411e-afc4-747058b284a6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:05:32.559742 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-79939fe0-1922-4f0f-8a8a-8b530193a95c tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:05:32.560229 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-79939fe0-1922-4f0f-8a8a-8b530193a95c tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:05:32.560663 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-79939fe0-1922-4f0f-8a8a-8b530193a95c tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:05:32.561362 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-79939fe0-1922-4f0f-8a8a-8b530193a95c tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:05:32.561811 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-79939fe0-1922-4f0f-8a8a-8b530193a95c tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:05:32.562239 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-79939fe0-1922-4f0f-8a8a-8b530193a95c tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:05:32.576467 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-79939fe0-1922-4f0f-8a8a-8b530193a95c tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] HTTP exception thrown: Instance 3a76679f-7a4a-411e-afc4-747058b284a6 could not be found. Sep 13 00:05:32.578162 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-79939fe0-1922-4f0f-8a8a-8b530193a95c tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Request method failure captured: Sep 13 00:05:32.578162 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: request: GET /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6 HTTP/1.1 Sep 13 00:05:32.578162 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept: application/json Sep 13 00:05:32.578162 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Sep 13 00:05:32.578162 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Connection: close Sep 13 00:05:32.578162 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Length: 0 Sep 13 00:05:32.578162 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Type: application/json Sep 13 00:05:32.578162 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Host: 10.222.0.26 Sep 13 00:05:32.578162 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Sep 13 00:05:32.578162 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Sep 13 00:05:32.578162 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjH8ieIf0SS7l927NoqdI6rNak3A3fj-EtELfnByFeDDlS_iJCl8Tx5W14auNs85ugE0SAUaG5GlsBIEpIt2r7LoLFF25y-Xut7lKss-jTEALd3Krxu7HCpSIaJf5NDsEWiNxUZJEPjvVubEx6gkAjine6C6XbJCnxMSnyECNt4Xjowo0 Sep 13 00:05:32.578162 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Sep 13 00:05:32.578162 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Sep 13 00:05:32.578162 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Sep 13 00:05:32.578162 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Sep 13 00:05:32.578162 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Sep 13 00:05:32.578162 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Sep 13 00:05:32.578162 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Id: ecac3196aefa4c32994f85a86849c8c8 Sep 13 00:05:32.578162 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-TestVolumeBootPattern-507873504 Sep 13 00:05:32.578162 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Role: member,reader Sep 13 00:05:32.578162 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Roles: member,reader Sep 13 00:05:32.579959 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ecac3196aefa4c32994f85a86849c8c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ecac3196aefa4c32994f85a86849c8c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ecac3196aefa4c32994f85a86849c8c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ecac3196aefa4c32994f85a86849c8c8"}]}] Sep 13 00:05:32.579959 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-TestVolumeBootPattern-507873504 Sep 13 00:05:32.579959 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Id: ecac3196aefa4c32994f85a86849c8c8 Sep 13 00:05:32.579959 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-TestVolumeBootPattern-507873504 Sep 13 00:05:32.579959 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User: tempest-TestVolumeBootPattern-507873504-project Sep 13 00:05:32.579959 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Sep 13 00:05:32.579959 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Sep 13 00:05:32.579959 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Id: f72b7cf8bf38477d8d6534eda6611982 Sep 13 00:05:32.579959 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-TestVolumeBootPattern-507873504-project Sep 13 00:05:32.579959 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: method: > Sep 13 00:05:32.579959 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: exception: Instance 3a76679f-7a4a-411e-afc4-747058b284a6 could not be found. Sep 13 00:05:32.579959 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: action_args: {'id': '3a76679f-7a4a-411e-afc4-747058b284a6'} Sep 13 00:05:32.580976 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 00:05:32.580976 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:05:32.580976 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 00:05:32.580976 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 00:05:32.580976 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 00:05:32.580976 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 00:05:32.580976 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 00:05:32.580976 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 00:05:32.580976 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 00:05:32.580976 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 00:05:32.580976 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a76679f-7a4a-411e-afc4-747058b284a6 could not be found. Sep 13 00:05:32.580976 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:05:32.580976 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 00:05:32.580976 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:05:32.580976 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:05:32.580976 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 00:05:32.580976 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 00:05:32.580976 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 00:05:32.580976 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 00:05:32.580976 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 00:05:32.582735 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 00:05:32.582735 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 00:05:32.582735 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 00:05:32.582735 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 00:05:32.582735 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 00:05:32.582735 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 00:05:32.582735 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 00:05:32.582735 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a76679f-7a4a-411e-afc4-747058b284a6 could not be found. Sep 13 00:05:32.582735 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:05:32.582735 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 00:05:32.582735 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:05:32.582735 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:05:32.582735 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 00:05:32.582735 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 00:05:32.582735 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 00:05:32.582735 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 00:05:32.582735 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a76679f-7a4a-411e-afc4-747058b284a6 could not be found. Sep 13 00:05:32.582735 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:05:32.584184 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-79939fe0-1922-4f0f-8a8a-8b530193a95c tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Returning 404 to user: Instance 3a76679f-7a4a-411e-afc4-747058b284a6 could not be found. {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 00:05:32.584184 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-79939fe0-1922-4f0f-8a8a-8b530193a95c tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6" status: 404 len: 111 microversion: 2.1 time: 0.032436 Sep 13 00:05:32.584184 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 475/945] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:05:32 2022] GET /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 00:05:32.685760 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3f8033bc-912d-4b9d-b1f4-f9be54a3c387 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2096705941", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1764420964", "security_groups": [{"name": "tempest-secgroup-smoke-479345869"}], "block_device_mapping_v2": [{"uuid": "08f5a1c9-954a-4a0b-a8b6-5ed90169f574", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "59fd1a5b-5d88-4e5e-aa91-1c1e68b4b584"}]}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 00:05:32.830240 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.network.neutron [None req-3f8033bc-912d-4b9d-b1f4-f9be54a3c387 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] validate_networks() for [('59fd1a5b-5d88-4e5e-aa91-1c1e68b4b584', None, None, None, None, None)] {{(pid=126976) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 00:05:33.297708 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-3f8033bc-912d-4b9d-b1f4-f9be54a3c387 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Flavor limits 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 00:05:33.298109 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-3f8033bc-912d-4b9d-b1f4-f9be54a3c387 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Image limits 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 00:05:33.298573 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-3f8033bc-912d-4b9d-b1f4-f9be54a3c387 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Flavor pref 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 00:05:33.298979 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-3f8033bc-912d-4b9d-b1f4-f9be54a3c387 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Image pref 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 00:05:33.299407 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-3f8033bc-912d-4b9d-b1f4-f9be54a3c387 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 00:05:33.312973 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3f8033bc-912d-4b9d-b1f4-f9be54a3c387 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:05:33.313465 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3f8033bc-912d-4b9d-b1f4-f9be54a3c387 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:05:33.314024 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3f8033bc-912d-4b9d-b1f4-f9be54a3c387 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:05:33.314759 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3f8033bc-912d-4b9d-b1f4-f9be54a3c387 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:05:33.315245 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3f8033bc-912d-4b9d-b1f4-f9be54a3c387 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:05:33.315663 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3f8033bc-912d-4b9d-b1f4-f9be54a3c387 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:05:33.332980 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-3f8033bc-912d-4b9d-b1f4-f9be54a3c387 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Getting quotas for project ecac3196aefa4c32994f85a86849c8c8. Resources: {'instances', 'cores', 'ram'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 00:05:33.337233 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-3f8033bc-912d-4b9d-b1f4-f9be54a3c387 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Getting quotas for user f72b7cf8bf38477d8d6534eda6611982 and project ecac3196aefa4c32994f85a86849c8c8. Resources: {'instances', 'cores', 'ram'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 00:05:33.402031 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3f8033bc-912d-4b9d-b1f4-f9be54a3c387 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Going to run 1 instances... {{(pid=126976) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 00:05:33.404242 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3f8033bc-912d-4b9d-b1f4-f9be54a3c387 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: a84f1bfa-7436-44a1-99b2-afed7be788d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='08f5a1c9-954a-4a0b-a8b6-5ed90169f574',volume_size=None,volume_type=None)] {{(pid=126976) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 00:05:33.545125 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3f8033bc-912d-4b9d-b1f4-f9be54a3c387 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.863168 Sep 13 00:05:33.545778 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 471/946] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Sep 13 00:05:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 00:05:33.557180 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-1cf84308-d1f0-475a-8e5c-3a90d3a6d1dc tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:05:33.557778 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-1cf84308-d1f0-475a-8e5c-3a90d3a6d1dc tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: a84f1bfa-7436-44a1-99b2-afed7be788d7] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:05:33.615551 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-1cf84308-d1f0-475a-8e5c-3a90d3a6d1dc tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:05:33.622608 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-1cf84308-d1f0-475a-8e5c-3a90d3a6d1dc tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/a84f1bfa-7436-44a1-99b2-afed7be788d7" status: 200 len: 1095 microversion: 2.1 time: 0.069343 Sep 13 00:05:33.623181 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 476/947] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:05:33 2022] GET /compute/v2.1/servers/a84f1bfa-7436-44a1-99b2-afed7be788d7 => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:05:34.646207 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-fca5376d-78f4-43e5-a681-0e8f59329477 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:05:34.646860 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-fca5376d-78f4-43e5-a681-0e8f59329477 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: a84f1bfa-7436-44a1-99b2-afed7be788d7] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:05:34.654268 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fca5376d-78f4-43e5-a681-0e8f59329477 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:05:34.654753 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fca5376d-78f4-43e5-a681-0e8f59329477 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:05:34.655180 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fca5376d-78f4-43e5-a681-0e8f59329477 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:05:34.655910 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fca5376d-78f4-43e5-a681-0e8f59329477 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:05:34.656358 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fca5376d-78f4-43e5-a681-0e8f59329477 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:05:34.656776 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fca5376d-78f4-43e5-a681-0e8f59329477 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:05:34.740239 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-fca5376d-78f4-43e5-a681-0e8f59329477 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:05:34.748841 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-fca5376d-78f4-43e5-a681-0e8f59329477 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/a84f1bfa-7436-44a1-99b2-afed7be788d7" status: 200 len: 1193 microversion: 2.1 time: 0.106647 Sep 13 00:05:34.750052 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 472/948] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:05:34 2022] GET /compute/v2.1/servers/a84f1bfa-7436-44a1-99b2-afed7be788d7 => generated 1193 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:05:35.775271 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-2d0cfd78-2f96-483d-9b66-cd8d7fa666d3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:05:35.776402 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-2d0cfd78-2f96-483d-9b66-cd8d7fa666d3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: a84f1bfa-7436-44a1-99b2-afed7be788d7] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:05:35.789084 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2d0cfd78-2f96-483d-9b66-cd8d7fa666d3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:05:35.789959 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2d0cfd78-2f96-483d-9b66-cd8d7fa666d3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:05:35.790778 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2d0cfd78-2f96-483d-9b66-cd8d7fa666d3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:05:35.791807 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2d0cfd78-2f96-483d-9b66-cd8d7fa666d3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:05:35.792626 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2d0cfd78-2f96-483d-9b66-cd8d7fa666d3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:05:35.793420 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-2d0cfd78-2f96-483d-9b66-cd8d7fa666d3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:05:36.030000 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-2d0cfd78-2f96-483d-9b66-cd8d7fa666d3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:05:36.039014 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-2d0cfd78-2f96-483d-9b66-cd8d7fa666d3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/a84f1bfa-7436-44a1-99b2-afed7be788d7" status: 200 len: 1266 microversion: 2.1 time: 0.269664 Sep 13 00:05:36.054421 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 477/949] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:05:35 2022] GET /compute/v2.1/servers/a84f1bfa-7436-44a1-99b2-afed7be788d7 => generated 1266 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:05:36.297897 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-6059fd52-090f-4f2b-91f8-fa5dc7763b03 req-9786161d-1e2b-4a60-939a-9c90830e6dc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a84f1bfa-7436-44a1-99b2-afed7be788d7", "tag": "1a401adb-f709-4d9f-85c3-c51e6e947891"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 00:05:36.309310 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-6059fd52-090f-4f2b-91f8-fa5dc7763b03 req-9786161d-1e2b-4a60-939a-9c90830e6dc3 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:05:36.309789 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-6059fd52-090f-4f2b-91f8-fa5dc7763b03 req-9786161d-1e2b-4a60-939a-9c90830e6dc3 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:05:36.310293 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-6059fd52-090f-4f2b-91f8-fa5dc7763b03 req-9786161d-1e2b-4a60-939a-9c90830e6dc3 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:05:36.322503 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-6059fd52-090f-4f2b-91f8-fa5dc7763b03 req-9786161d-1e2b-4a60-939a-9c90830e6dc3 service nova] Creating event network-changed:1a401adb-f709-4d9f-85c3-c51e6e947891 for instance a84f1bfa-7436-44a1-99b2-afed7be788d7 on hv-cinder-82002 Sep 13 00:05:36.327714 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-6059fd52-090f-4f2b-91f8-fa5dc7763b03 req-9786161d-1e2b-4a60-939a-9c90830e6dc3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033332 Sep 13 00:05:36.328546 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 473/950] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 13 00:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 00:05:37.061727 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-930366ca-d7b0-4abf-93ca-38d16a3a53b3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:05:37.062350 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-930366ca-d7b0-4abf-93ca-38d16a3a53b3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: a84f1bfa-7436-44a1-99b2-afed7be788d7] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:05:37.070392 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-930366ca-d7b0-4abf-93ca-38d16a3a53b3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:05:37.070392 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-930366ca-d7b0-4abf-93ca-38d16a3a53b3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:05:37.070799 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-930366ca-d7b0-4abf-93ca-38d16a3a53b3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:05:37.071539 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-930366ca-d7b0-4abf-93ca-38d16a3a53b3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:05:37.071996 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-930366ca-d7b0-4abf-93ca-38d16a3a53b3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:05:37.072423 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-930366ca-d7b0-4abf-93ca-38d16a3a53b3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:05:37.580860 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-930366ca-d7b0-4abf-93ca-38d16a3a53b3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:05:37.589157 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-930366ca-d7b0-4abf-93ca-38d16a3a53b3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/a84f1bfa-7436-44a1-99b2-afed7be788d7" status: 200 len: 1266 microversion: 2.1 time: 0.531380 Sep 13 00:05:37.589949 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 478/951] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:05:37 2022] GET /compute/v2.1/servers/a84f1bfa-7436-44a1-99b2-afed7be788d7 => generated 1266 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:05:38.613801 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-73106274-4fa4-4681-b6a7-26b941431471 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:05:38.614473 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-73106274-4fa4-4681-b6a7-26b941431471 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: a84f1bfa-7436-44a1-99b2-afed7be788d7] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:05:38.621732 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-73106274-4fa4-4681-b6a7-26b941431471 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:05:38.622101 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-73106274-4fa4-4681-b6a7-26b941431471 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:05:38.622505 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-73106274-4fa4-4681-b6a7-26b941431471 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:05:38.623258 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-73106274-4fa4-4681-b6a7-26b941431471 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:05:38.623722 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-73106274-4fa4-4681-b6a7-26b941431471 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:05:38.624168 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-73106274-4fa4-4681-b6a7-26b941431471 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:05:38.786469 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-73106274-4fa4-4681-b6a7-26b941431471 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:05:38.797335 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-73106274-4fa4-4681-b6a7-26b941431471 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/a84f1bfa-7436-44a1-99b2-afed7be788d7" status: 200 len: 1266 microversion: 2.1 time: 0.188334 Sep 13 00:05:38.798950 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 474/952] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:05:38 2022] GET /compute/v2.1/servers/a84f1bfa-7436-44a1-99b2-afed7be788d7 => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:05:39.824789 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a8037b9d-ec00-469f-bf91-6be5affa34b9 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:05:39.825441 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a8037b9d-ec00-469f-bf91-6be5affa34b9 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: a84f1bfa-7436-44a1-99b2-afed7be788d7] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:05:39.835197 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a8037b9d-ec00-469f-bf91-6be5affa34b9 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:05:39.835943 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a8037b9d-ec00-469f-bf91-6be5affa34b9 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:05:39.836564 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a8037b9d-ec00-469f-bf91-6be5affa34b9 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:05:39.837549 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a8037b9d-ec00-469f-bf91-6be5affa34b9 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:05:39.838230 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a8037b9d-ec00-469f-bf91-6be5affa34b9 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:05:39.838729 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a8037b9d-ec00-469f-bf91-6be5affa34b9 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:05:39.990391 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a8037b9d-ec00-469f-bf91-6be5affa34b9 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:05:39.998912 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a8037b9d-ec00-469f-bf91-6be5affa34b9 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/a84f1bfa-7436-44a1-99b2-afed7be788d7" status: 200 len: 1266 microversion: 2.1 time: 0.179509 Sep 13 00:05:39.999519 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 479/953] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:05:39 2022] GET /compute/v2.1/servers/a84f1bfa-7436-44a1-99b2-afed7be788d7 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:05:41.025573 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-43b7093c-2920-4abb-b0b9-18578338ae6d tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:05:41.026216 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-43b7093c-2920-4abb-b0b9-18578338ae6d tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: a84f1bfa-7436-44a1-99b2-afed7be788d7] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:05:41.034968 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-43b7093c-2920-4abb-b0b9-18578338ae6d tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:05:41.035493 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-43b7093c-2920-4abb-b0b9-18578338ae6d tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:05:41.035935 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-43b7093c-2920-4abb-b0b9-18578338ae6d tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:05:41.036643 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-43b7093c-2920-4abb-b0b9-18578338ae6d tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:05:41.037102 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-43b7093c-2920-4abb-b0b9-18578338ae6d tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:05:41.037532 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-43b7093c-2920-4abb-b0b9-18578338ae6d tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:05:41.188732 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-43b7093c-2920-4abb-b0b9-18578338ae6d tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:05:41.196698 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-43b7093c-2920-4abb-b0b9-18578338ae6d tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/a84f1bfa-7436-44a1-99b2-afed7be788d7" status: 200 len: 1266 microversion: 2.1 time: 0.177212 Sep 13 00:05:41.197274 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 475/954] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:05:41 2022] GET /compute/v2.1/servers/a84f1bfa-7436-44a1-99b2-afed7be788d7 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:05:42.219685 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f0649ec6-5b28-4722-96a6-0ad782dd0786 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:05:42.220295 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f0649ec6-5b28-4722-96a6-0ad782dd0786 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: a84f1bfa-7436-44a1-99b2-afed7be788d7] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:05:42.227608 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f0649ec6-5b28-4722-96a6-0ad782dd0786 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:05:42.228104 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f0649ec6-5b28-4722-96a6-0ad782dd0786 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:05:42.228543 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f0649ec6-5b28-4722-96a6-0ad782dd0786 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:05:42.229242 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f0649ec6-5b28-4722-96a6-0ad782dd0786 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:05:42.229704 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f0649ec6-5b28-4722-96a6-0ad782dd0786 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:05:42.230131 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f0649ec6-5b28-4722-96a6-0ad782dd0786 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:05:42.396618 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f0649ec6-5b28-4722-96a6-0ad782dd0786 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:05:42.409095 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f0649ec6-5b28-4722-96a6-0ad782dd0786 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/a84f1bfa-7436-44a1-99b2-afed7be788d7" status: 200 len: 1266 microversion: 2.1 time: 0.193114 Sep 13 00:05:42.410027 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 480/955] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:05:42 2022] GET /compute/v2.1/servers/a84f1bfa-7436-44a1-99b2-afed7be788d7 => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:05:43.433476 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-40ebf4dc-8ac7-4712-8ff2-5730719cb19b tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:05:43.434090 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-40ebf4dc-8ac7-4712-8ff2-5730719cb19b tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: a84f1bfa-7436-44a1-99b2-afed7be788d7] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:05:43.436603 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell0:SELECT=2 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:05:43.437268 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell0:SELECT=6 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:05:43.443524 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-40ebf4dc-8ac7-4712-8ff2-5730719cb19b tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:05:43.444008 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-40ebf4dc-8ac7-4712-8ff2-5730719cb19b tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:05:43.444444 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-40ebf4dc-8ac7-4712-8ff2-5730719cb19b tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:05:43.445139 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-40ebf4dc-8ac7-4712-8ff2-5730719cb19b tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:05:43.445594 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-40ebf4dc-8ac7-4712-8ff2-5730719cb19b tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:05:43.446013 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-40ebf4dc-8ac7-4712-8ff2-5730719cb19b tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:05:43.586755 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-40ebf4dc-8ac7-4712-8ff2-5730719cb19b tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:05:43.598672 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-40ebf4dc-8ac7-4712-8ff2-5730719cb19b tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/a84f1bfa-7436-44a1-99b2-afed7be788d7" status: 200 len: 1266 microversion: 2.1 time: 0.168867 Sep 13 00:05:43.599264 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 476/956] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:05:43 2022] GET /compute/v2.1/servers/a84f1bfa-7436-44a1-99b2-afed7be788d7 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:05:44.624705 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-53763c3f-4b0d-40ac-8236-0321748cffed tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:05:44.625521 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-53763c3f-4b0d-40ac-8236-0321748cffed tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: a84f1bfa-7436-44a1-99b2-afed7be788d7] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:05:44.628891 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell0:SELECT=2 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:05:44.634918 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-53763c3f-4b0d-40ac-8236-0321748cffed tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:05:44.635433 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-53763c3f-4b0d-40ac-8236-0321748cffed tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:05:44.635869 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-53763c3f-4b0d-40ac-8236-0321748cffed tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:05:44.636577 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-53763c3f-4b0d-40ac-8236-0321748cffed tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:05:44.637051 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-53763c3f-4b0d-40ac-8236-0321748cffed tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:05:44.637459 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-53763c3f-4b0d-40ac-8236-0321748cffed tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:05:44.780385 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-53763c3f-4b0d-40ac-8236-0321748cffed tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:05:44.791784 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-53763c3f-4b0d-40ac-8236-0321748cffed tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/a84f1bfa-7436-44a1-99b2-afed7be788d7" status: 200 len: 1266 microversion: 2.1 time: 0.172072 Sep 13 00:05:44.792466 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 481/957] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:05:44 2022] GET /compute/v2.1/servers/a84f1bfa-7436-44a1-99b2-afed7be788d7 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:05:45.818551 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-bd11aa9b-4d1f-4132-bc1b-104304b64508 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:05:45.819146 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-bd11aa9b-4d1f-4132-bc1b-104304b64508 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: a84f1bfa-7436-44a1-99b2-afed7be788d7] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:05:45.825661 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd11aa9b-4d1f-4132-bc1b-104304b64508 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:05:45.826142 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd11aa9b-4d1f-4132-bc1b-104304b64508 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:05:45.826581 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd11aa9b-4d1f-4132-bc1b-104304b64508 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:05:45.827305 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd11aa9b-4d1f-4132-bc1b-104304b64508 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:05:45.827766 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd11aa9b-4d1f-4132-bc1b-104304b64508 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:05:45.828190 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-bd11aa9b-4d1f-4132-bc1b-104304b64508 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:05:45.960325 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-bd11aa9b-4d1f-4132-bc1b-104304b64508 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:05:45.968186 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-bd11aa9b-4d1f-4132-bc1b-104304b64508 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/a84f1bfa-7436-44a1-99b2-afed7be788d7" status: 200 len: 1266 microversion: 2.1 time: 0.156293 Sep 13 00:05:45.968743 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 477/958] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:05:45 2022] GET /compute/v2.1/servers/a84f1bfa-7436-44a1-99b2-afed7be788d7 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:05:46.993039 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-11e70d80-114d-49e7-a591-f7f3584921bc tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:05:46.993690 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-11e70d80-114d-49e7-a591-f7f3584921bc tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: a84f1bfa-7436-44a1-99b2-afed7be788d7] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:05:47.000714 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-11e70d80-114d-49e7-a591-f7f3584921bc tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:05:47.001187 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-11e70d80-114d-49e7-a591-f7f3584921bc tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:05:47.001628 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-11e70d80-114d-49e7-a591-f7f3584921bc tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:05:47.002320 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-11e70d80-114d-49e7-a591-f7f3584921bc tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:05:47.002790 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-11e70d80-114d-49e7-a591-f7f3584921bc tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:05:47.003204 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-11e70d80-114d-49e7-a591-f7f3584921bc tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:05:47.147613 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-11e70d80-114d-49e7-a591-f7f3584921bc tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:05:47.155820 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-11e70d80-114d-49e7-a591-f7f3584921bc tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/a84f1bfa-7436-44a1-99b2-afed7be788d7" status: 200 len: 1266 microversion: 2.1 time: 0.167529 Sep 13 00:05:47.156392 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 482/959] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:05:46 2022] GET /compute/v2.1/servers/a84f1bfa-7436-44a1-99b2-afed7be788d7 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:05:48.178540 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2f715e8e-d71b-4266-aad7-36220e9dcc9e tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:05:48.179123 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2f715e8e-d71b-4266-aad7-36220e9dcc9e tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: a84f1bfa-7436-44a1-99b2-afed7be788d7] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:05:48.186313 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2f715e8e-d71b-4266-aad7-36220e9dcc9e tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:05:48.186796 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2f715e8e-d71b-4266-aad7-36220e9dcc9e tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:05:48.187258 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2f715e8e-d71b-4266-aad7-36220e9dcc9e tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:05:48.187961 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2f715e8e-d71b-4266-aad7-36220e9dcc9e tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:05:48.188415 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2f715e8e-d71b-4266-aad7-36220e9dcc9e tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:05:48.188872 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2f715e8e-d71b-4266-aad7-36220e9dcc9e tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:05:48.255318 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-6fff73d2-2c33-4f7a-8fd0-461c44a29871 req-3b6a7006-8d94-4460-8fb3-fc6958f1dc9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a84f1bfa-7436-44a1-99b2-afed7be788d7", "name": "network-vif-plugged", "status": "completed", "tag": "1a401adb-f709-4d9f-85c3-c51e6e947891"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 00:05:48.267419 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-6fff73d2-2c33-4f7a-8fd0-461c44a29871 req-3b6a7006-8d94-4460-8fb3-fc6958f1dc9b service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:05:48.267986 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-6fff73d2-2c33-4f7a-8fd0-461c44a29871 req-3b6a7006-8d94-4460-8fb3-fc6958f1dc9b service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:05:48.268416 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-6fff73d2-2c33-4f7a-8fd0-461c44a29871 req-3b6a7006-8d94-4460-8fb3-fc6958f1dc9b service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:05:48.280727 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-6fff73d2-2c33-4f7a-8fd0-461c44a29871 req-3b6a7006-8d94-4460-8fb3-fc6958f1dc9b service nova] Creating event network-vif-plugged:1a401adb-f709-4d9f-85c3-c51e6e947891 for instance a84f1bfa-7436-44a1-99b2-afed7be788d7 on hv-cinder-82002 Sep 13 00:05:48.289708 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-6fff73d2-2c33-4f7a-8fd0-461c44a29871 req-3b6a7006-8d94-4460-8fb3-fc6958f1dc9b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038179 Sep 13 00:05:48.291083 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 483/960] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 13 00:05:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 00:05:48.335657 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2f715e8e-d71b-4266-aad7-36220e9dcc9e tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:05:48.343647 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2f715e8e-d71b-4266-aad7-36220e9dcc9e tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/a84f1bfa-7436-44a1-99b2-afed7be788d7" status: 200 len: 1266 microversion: 2.1 time: 0.169065 Sep 13 00:05:48.344216 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 478/961] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:05:48 2022] GET /compute/v2.1/servers/a84f1bfa-7436-44a1-99b2-afed7be788d7 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:05:49.367792 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-45bde4f4-3dc2-4293-890f-3efe28bec7dc tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:05:49.368445 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-45bde4f4-3dc2-4293-890f-3efe28bec7dc tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: a84f1bfa-7436-44a1-99b2-afed7be788d7] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:05:49.375392 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-45bde4f4-3dc2-4293-890f-3efe28bec7dc tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:05:49.375887 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-45bde4f4-3dc2-4293-890f-3efe28bec7dc tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:05:49.376323 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-45bde4f4-3dc2-4293-890f-3efe28bec7dc tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:05:49.377036 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-45bde4f4-3dc2-4293-890f-3efe28bec7dc tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:05:49.377491 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-45bde4f4-3dc2-4293-890f-3efe28bec7dc tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:05:49.377915 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-45bde4f4-3dc2-4293-890f-3efe28bec7dc tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:05:49.525252 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-45bde4f4-3dc2-4293-890f-3efe28bec7dc tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:05:49.536771 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-45bde4f4-3dc2-4293-890f-3efe28bec7dc tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/a84f1bfa-7436-44a1-99b2-afed7be788d7" status: 200 len: 1266 microversion: 2.1 time: 0.173894 Sep 13 00:05:49.537529 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 484/962] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:05:49 2022] GET /compute/v2.1/servers/a84f1bfa-7436-44a1-99b2-afed7be788d7 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:05:50.566285 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-ecee356e-8d10-421e-8c27-d1c24f17fe7b tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:05:50.566891 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-ecee356e-8d10-421e-8c27-d1c24f17fe7b tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: a84f1bfa-7436-44a1-99b2-afed7be788d7] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:05:50.573786 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ecee356e-8d10-421e-8c27-d1c24f17fe7b tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:05:50.574281 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ecee356e-8d10-421e-8c27-d1c24f17fe7b tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:05:50.574717 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ecee356e-8d10-421e-8c27-d1c24f17fe7b tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:05:50.575458 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ecee356e-8d10-421e-8c27-d1c24f17fe7b tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:05:50.575913 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ecee356e-8d10-421e-8c27-d1c24f17fe7b tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:05:50.576438 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-ecee356e-8d10-421e-8c27-d1c24f17fe7b tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:05:50.715376 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-ecee356e-8d10-421e-8c27-d1c24f17fe7b tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:05:50.723614 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-ecee356e-8d10-421e-8c27-d1c24f17fe7b tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/a84f1bfa-7436-44a1-99b2-afed7be788d7" status: 200 len: 1452 microversion: 2.1 time: 0.161407 Sep 13 00:05:50.724167 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 479/963] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:05:50 2022] GET /compute/v2.1/servers/a84f1bfa-7436-44a1-99b2-afed7be788d7 => generated 1452 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:05:50.745721 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-bc1d7418-5929-4cc8-9db6-1596829137fe tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:05:50.746324 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-bc1d7418-5929-4cc8-9db6-1596829137fe tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: a84f1bfa-7436-44a1-99b2-afed7be788d7] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:05:50.753496 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bc1d7418-5929-4cc8-9db6-1596829137fe tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:05:50.753973 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bc1d7418-5929-4cc8-9db6-1596829137fe tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:05:50.754406 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bc1d7418-5929-4cc8-9db6-1596829137fe tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:05:50.755095 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bc1d7418-5929-4cc8-9db6-1596829137fe tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:05:50.755587 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bc1d7418-5929-4cc8-9db6-1596829137fe tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:05:50.756011 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-bc1d7418-5929-4cc8-9db6-1596829137fe tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:05:50.891466 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-bc1d7418-5929-4cc8-9db6-1596829137fe tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:05:50.899589 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-bc1d7418-5929-4cc8-9db6-1596829137fe tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/a84f1bfa-7436-44a1-99b2-afed7be788d7" status: 200 len: 1452 microversion: 2.1 time: 0.157674 Sep 13 00:05:50.900158 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 485/964] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:05:50 2022] GET /compute/v2.1/servers/a84f1bfa-7436-44a1-99b2-afed7be788d7 => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:05:52.606993 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-54f39f04-036b-4d3a-9fb8-1c9da2a4aaa8 req-00f95eb3-cb2d-49c0-82e5-cad84069ac95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a84f1bfa-7436-44a1-99b2-afed7be788d7", "tag": "1a401adb-f709-4d9f-85c3-c51e6e947891"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 00:05:52.617700 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-54f39f04-036b-4d3a-9fb8-1c9da2a4aaa8 req-00f95eb3-cb2d-49c0-82e5-cad84069ac95 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:05:52.618167 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-54f39f04-036b-4d3a-9fb8-1c9da2a4aaa8 req-00f95eb3-cb2d-49c0-82e5-cad84069ac95 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:05:52.618594 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-54f39f04-036b-4d3a-9fb8-1c9da2a4aaa8 req-00f95eb3-cb2d-49c0-82e5-cad84069ac95 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:05:52.630582 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-54f39f04-036b-4d3a-9fb8-1c9da2a4aaa8 req-00f95eb3-cb2d-49c0-82e5-cad84069ac95 service nova] Creating event network-changed:1a401adb-f709-4d9f-85c3-c51e6e947891 for instance a84f1bfa-7436-44a1-99b2-afed7be788d7 on hv-cinder-82002 Sep 13 00:05:52.636445 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-54f39f04-036b-4d3a-9fb8-1c9da2a4aaa8 req-00f95eb3-cb2d-49c0-82e5-cad84069ac95 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033467 Sep 13 00:05:52.637258 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 480/965] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 13 00:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 00:06:40.327556 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-44ee0d41-c20c-4240-82c4-ab231259df3d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 00:06:40.328157 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-44ee0d41-c20c-4240-82c4-ab231259df3d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] [instance: 5a30688a-8c79-425d-9679-0b15397e2c2b] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:06:40.330408 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:06:40.331122 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:06:40.337282 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-44ee0d41-c20c-4240-82c4-ab231259df3d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:06:40.337770 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-44ee0d41-c20c-4240-82c4-ab231259df3d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:06:40.338185 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-44ee0d41-c20c-4240-82c4-ab231259df3d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:06:40.338887 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-44ee0d41-c20c-4240-82c4-ab231259df3d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:06:40.339375 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-44ee0d41-c20c-4240-82c4-ab231259df3d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:06:40.339800 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-44ee0d41-c20c-4240-82c4-ab231259df3d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:06:40.365816 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.objects.instance [None req-44ee0d41-c20c-4240-82c4-ab231259df3d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lazy-loading 'flavor' on Instance uuid 5a30688a-8c79-425d-9679-0b15397e2c2b {{(pid=126975) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 00:06:40.450568 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-44ee0d41-c20c-4240-82c4-ab231259df3d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] 10.222.0.26 "POST /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b/action" status: 202 len: 0 microversion: 2.1 time: 0.127155 Sep 13 00:06:40.451156 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 486/966] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Sep 13 00:06:40 2022] POST /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 00:06:40.461499 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3af0f66e-89c2-43d7-9595-740d00ba9db8 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:06:40.462963 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3af0f66e-89c2-43d7-9595-740d00ba9db8 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] [instance: 5a30688a-8c79-425d-9679-0b15397e2c2b] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:06:40.465696 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:06:40.466338 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=68 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:06:40.474307 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3af0f66e-89c2-43d7-9595-740d00ba9db8 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:06:40.474827 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3af0f66e-89c2-43d7-9595-740d00ba9db8 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:06:40.475428 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3af0f66e-89c2-43d7-9595-740d00ba9db8 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:06:40.476151 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3af0f66e-89c2-43d7-9595-740d00ba9db8 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:06:40.476597 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3af0f66e-89c2-43d7-9595-740d00ba9db8 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:06:40.477058 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3af0f66e-89c2-43d7-9595-740d00ba9db8 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:06:40.627266 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3af0f66e-89c2-43d7-9595-740d00ba9db8 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb103e002840445db31703e141cf3a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b62652571943b58f9c8bd4c1ee9931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:06:40.636288 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3af0f66e-89c2-43d7-9595-740d00ba9db8 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] 10.222.0.26 "GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b" status: 200 len: 1568 microversion: 2.1 time: 0.179958 Sep 13 00:06:40.636869 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 481/967] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:06:40 2022] GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:06:41.665032 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-25e07570-cc39-4eec-987d-c60f9bbb7503 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:06:41.665771 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-25e07570-cc39-4eec-987d-c60f9bbb7503 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] [instance: 5a30688a-8c79-425d-9679-0b15397e2c2b] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:06:41.674937 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-25e07570-cc39-4eec-987d-c60f9bbb7503 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:06:41.675480 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-25e07570-cc39-4eec-987d-c60f9bbb7503 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:06:41.675927 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-25e07570-cc39-4eec-987d-c60f9bbb7503 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:06:41.676632 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-25e07570-cc39-4eec-987d-c60f9bbb7503 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:06:41.677086 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-25e07570-cc39-4eec-987d-c60f9bbb7503 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:06:41.677507 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-25e07570-cc39-4eec-987d-c60f9bbb7503 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:06:41.814721 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-25e07570-cc39-4eec-987d-c60f9bbb7503 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb103e002840445db31703e141cf3a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b62652571943b58f9c8bd4c1ee9931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:06:41.826267 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-25e07570-cc39-4eec-987d-c60f9bbb7503 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] 10.222.0.26 "GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b" status: 200 len: 1568 microversion: 2.1 time: 0.168192 Sep 13 00:06:41.826988 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 487/968] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:06:41 2022] GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:06:42.856574 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d9546abe-95be-4703-907e-150bbb00ff16 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:06:42.857492 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d9546abe-95be-4703-907e-150bbb00ff16 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] [instance: 5a30688a-8c79-425d-9679-0b15397e2c2b] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:06:42.866452 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d9546abe-95be-4703-907e-150bbb00ff16 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:06:42.867149 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d9546abe-95be-4703-907e-150bbb00ff16 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:06:42.867811 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d9546abe-95be-4703-907e-150bbb00ff16 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:06:42.868809 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d9546abe-95be-4703-907e-150bbb00ff16 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:06:42.869462 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d9546abe-95be-4703-907e-150bbb00ff16 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:06:42.870067 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d9546abe-95be-4703-907e-150bbb00ff16 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:06:43.026636 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d9546abe-95be-4703-907e-150bbb00ff16 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb103e002840445db31703e141cf3a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b62652571943b58f9c8bd4c1ee9931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:06:43.034923 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d9546abe-95be-4703-907e-150bbb00ff16 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] 10.222.0.26 "GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b" status: 200 len: 1568 microversion: 2.1 time: 0.185502 Sep 13 00:06:43.035529 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 482/969] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:06:42 2022] GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:06:44.061197 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d0222c12-a68b-4664-8f92-d07dc1ef095d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:06:44.062033 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d0222c12-a68b-4664-8f92-d07dc1ef095d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] [instance: 5a30688a-8c79-425d-9679-0b15397e2c2b] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:06:44.071613 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0222c12-a68b-4664-8f92-d07dc1ef095d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:06:44.072334 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0222c12-a68b-4664-8f92-d07dc1ef095d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:06:44.073400 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0222c12-a68b-4664-8f92-d07dc1ef095d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:06:44.073917 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0222c12-a68b-4664-8f92-d07dc1ef095d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:06:44.074541 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0222c12-a68b-4664-8f92-d07dc1ef095d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:06:44.075140 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d0222c12-a68b-4664-8f92-d07dc1ef095d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:06:44.232228 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d0222c12-a68b-4664-8f92-d07dc1ef095d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb103e002840445db31703e141cf3a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b62652571943b58f9c8bd4c1ee9931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:06:44.240141 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d0222c12-a68b-4664-8f92-d07dc1ef095d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] 10.222.0.26 "GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b" status: 200 len: 1568 microversion: 2.1 time: 0.184602 Sep 13 00:06:44.240747 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 488/970] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:06:44 2022] GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b => generated 1568 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:06:45.266040 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-7c659a4f-99d1-4584-9344-dacccf676e1d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:06:45.266613 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-7c659a4f-99d1-4584-9344-dacccf676e1d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] [instance: 5a30688a-8c79-425d-9679-0b15397e2c2b] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:06:45.273918 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7c659a4f-99d1-4584-9344-dacccf676e1d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:06:45.274444 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7c659a4f-99d1-4584-9344-dacccf676e1d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:06:45.274877 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7c659a4f-99d1-4584-9344-dacccf676e1d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:06:45.275604 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7c659a4f-99d1-4584-9344-dacccf676e1d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:06:45.276074 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7c659a4f-99d1-4584-9344-dacccf676e1d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:06:45.276498 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-7c659a4f-99d1-4584-9344-dacccf676e1d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:06:45.437744 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-7c659a4f-99d1-4584-9344-dacccf676e1d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb103e002840445db31703e141cf3a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b62652571943b58f9c8bd4c1ee9931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:06:45.446391 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-7c659a4f-99d1-4584-9344-dacccf676e1d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] 10.222.0.26 "GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b" status: 200 len: 1568 microversion: 2.1 time: 0.186517 Sep 13 00:06:45.446983 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 483/971] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:06:45 2022] GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:06:46.475399 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8e9586dd-7758-401b-917f-dd8096b49650 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:06:46.476010 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8e9586dd-7758-401b-917f-dd8096b49650 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] [instance: 5a30688a-8c79-425d-9679-0b15397e2c2b] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:06:46.483786 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e9586dd-7758-401b-917f-dd8096b49650 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:06:46.484296 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e9586dd-7758-401b-917f-dd8096b49650 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:06:46.484729 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e9586dd-7758-401b-917f-dd8096b49650 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:06:46.485426 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e9586dd-7758-401b-917f-dd8096b49650 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:06:46.485874 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e9586dd-7758-401b-917f-dd8096b49650 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:06:46.486295 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8e9586dd-7758-401b-917f-dd8096b49650 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:06:46.632993 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8e9586dd-7758-401b-917f-dd8096b49650 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb103e002840445db31703e141cf3a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b62652571943b58f9c8bd4c1ee9931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:06:46.641779 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8e9586dd-7758-401b-917f-dd8096b49650 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] 10.222.0.26 "GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b" status: 200 len: 1568 microversion: 2.1 time: 0.174346 Sep 13 00:06:46.642346 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 489/972] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:06:46 2022] GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:06:47.665354 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c378daf5-d8cc-40b4-b310-86ac23a3766d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:06:47.665967 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-c378daf5-d8cc-40b4-b310-86ac23a3766d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] [instance: 5a30688a-8c79-425d-9679-0b15397e2c2b] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:06:47.673118 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c378daf5-d8cc-40b4-b310-86ac23a3766d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:06:47.673609 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c378daf5-d8cc-40b4-b310-86ac23a3766d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:06:47.674067 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c378daf5-d8cc-40b4-b310-86ac23a3766d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:06:47.674768 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c378daf5-d8cc-40b4-b310-86ac23a3766d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:06:47.675245 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c378daf5-d8cc-40b4-b310-86ac23a3766d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:06:47.675765 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-c378daf5-d8cc-40b4-b310-86ac23a3766d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:06:47.819889 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-c378daf5-d8cc-40b4-b310-86ac23a3766d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb103e002840445db31703e141cf3a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b62652571943b58f9c8bd4c1ee9931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:06:47.827917 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c378daf5-d8cc-40b4-b310-86ac23a3766d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] 10.222.0.26 "GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b" status: 200 len: 1568 microversion: 2.1 time: 0.166573 Sep 13 00:06:47.828463 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 484/973] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:06:47 2022] GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:06:48.852675 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f64fa511-37e5-412c-a664-a16d0662873b tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:06:48.853349 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f64fa511-37e5-412c-a664-a16d0662873b tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] [instance: 5a30688a-8c79-425d-9679-0b15397e2c2b] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:06:48.862048 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f64fa511-37e5-412c-a664-a16d0662873b tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:06:48.862675 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f64fa511-37e5-412c-a664-a16d0662873b tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:06:48.863282 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f64fa511-37e5-412c-a664-a16d0662873b tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:06:48.864036 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f64fa511-37e5-412c-a664-a16d0662873b tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:06:48.864614 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f64fa511-37e5-412c-a664-a16d0662873b tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:06:48.865185 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f64fa511-37e5-412c-a664-a16d0662873b tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:06:49.007070 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-f64fa511-37e5-412c-a664-a16d0662873b tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb103e002840445db31703e141cf3a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b62652571943b58f9c8bd4c1ee9931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:06:49.017640 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f64fa511-37e5-412c-a664-a16d0662873b tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] 10.222.0.26 "GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b" status: 200 len: 1568 microversion: 2.1 time: 0.169732 Sep 13 00:06:49.018423 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 490/974] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:06:48 2022] GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:06:50.044162 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e1c3d6c8-8c64-4e20-af4e-f50e01cbcf4f tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:06:50.044900 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e1c3d6c8-8c64-4e20-af4e-f50e01cbcf4f tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] [instance: 5a30688a-8c79-425d-9679-0b15397e2c2b] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:06:50.053617 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e1c3d6c8-8c64-4e20-af4e-f50e01cbcf4f tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:06:50.054079 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e1c3d6c8-8c64-4e20-af4e-f50e01cbcf4f tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:06:50.054544 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e1c3d6c8-8c64-4e20-af4e-f50e01cbcf4f tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:06:50.055262 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e1c3d6c8-8c64-4e20-af4e-f50e01cbcf4f tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:06:50.055729 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e1c3d6c8-8c64-4e20-af4e-f50e01cbcf4f tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:06:50.056156 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e1c3d6c8-8c64-4e20-af4e-f50e01cbcf4f tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:06:50.208674 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e1c3d6c8-8c64-4e20-af4e-f50e01cbcf4f tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb103e002840445db31703e141cf3a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b62652571943b58f9c8bd4c1ee9931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:06:50.216868 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e1c3d6c8-8c64-4e20-af4e-f50e01cbcf4f tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] 10.222.0.26 "GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b" status: 200 len: 1568 microversion: 2.1 time: 0.178429 Sep 13 00:06:50.217447 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 485/975] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:06:50 2022] GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:06:51.240900 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8fa4a8a6-8f94-41e9-af8b-8e3b8c3b129d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:06:51.241533 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8fa4a8a6-8f94-41e9-af8b-8e3b8c3b129d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] [instance: 5a30688a-8c79-425d-9679-0b15397e2c2b] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:06:51.249096 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8fa4a8a6-8f94-41e9-af8b-8e3b8c3b129d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:06:51.249621 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8fa4a8a6-8f94-41e9-af8b-8e3b8c3b129d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:06:51.250022 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8fa4a8a6-8f94-41e9-af8b-8e3b8c3b129d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:06:51.250769 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8fa4a8a6-8f94-41e9-af8b-8e3b8c3b129d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:06:51.251241 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8fa4a8a6-8f94-41e9-af8b-8e3b8c3b129d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:06:51.251686 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8fa4a8a6-8f94-41e9-af8b-8e3b8c3b129d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:06:51.626785 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8fa4a8a6-8f94-41e9-af8b-8e3b8c3b129d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb103e002840445db31703e141cf3a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b62652571943b58f9c8bd4c1ee9931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:06:51.635584 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8fa4a8a6-8f94-41e9-af8b-8e3b8c3b129d tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] 10.222.0.26 "GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b" status: 200 len: 1568 microversion: 2.1 time: 0.398660 Sep 13 00:06:51.636414 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 491/976] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:06:51 2022] GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b => generated 1568 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:06:52.661801 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-dd81c648-b2b5-47d1-bcd1-b724bdab8f6b tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:06:52.662415 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-dd81c648-b2b5-47d1-bcd1-b724bdab8f6b tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] [instance: 5a30688a-8c79-425d-9679-0b15397e2c2b] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:06:52.669686 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dd81c648-b2b5-47d1-bcd1-b724bdab8f6b tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:06:52.670170 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dd81c648-b2b5-47d1-bcd1-b724bdab8f6b tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:06:52.670610 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dd81c648-b2b5-47d1-bcd1-b724bdab8f6b tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:06:52.671344 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dd81c648-b2b5-47d1-bcd1-b724bdab8f6b tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:06:52.671800 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dd81c648-b2b5-47d1-bcd1-b724bdab8f6b tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:06:52.672227 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-dd81c648-b2b5-47d1-bcd1-b724bdab8f6b tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:06:52.806111 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-dd81c648-b2b5-47d1-bcd1-b724bdab8f6b tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb103e002840445db31703e141cf3a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b62652571943b58f9c8bd4c1ee9931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:06:52.814058 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-dd81c648-b2b5-47d1-bcd1-b724bdab8f6b tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] 10.222.0.26 "GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b" status: 200 len: 1568 microversion: 2.1 time: 0.158005 Sep 13 00:06:52.814647 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 486/977] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:06:52 2022] GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:06:53.837449 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ea649a8b-2042-42fa-88cf-44288f264881 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:06:53.838166 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ea649a8b-2042-42fa-88cf-44288f264881 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] [instance: 5a30688a-8c79-425d-9679-0b15397e2c2b] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:06:53.844598 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ea649a8b-2042-42fa-88cf-44288f264881 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:06:53.845080 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ea649a8b-2042-42fa-88cf-44288f264881 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:06:53.845506 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ea649a8b-2042-42fa-88cf-44288f264881 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:06:53.846196 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ea649a8b-2042-42fa-88cf-44288f264881 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:06:53.846644 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ea649a8b-2042-42fa-88cf-44288f264881 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:06:53.847101 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ea649a8b-2042-42fa-88cf-44288f264881 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:06:54.011928 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-ea649a8b-2042-42fa-88cf-44288f264881 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb103e002840445db31703e141cf3a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b62652571943b58f9c8bd4c1ee9931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:06:54.021223 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ea649a8b-2042-42fa-88cf-44288f264881 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] 10.222.0.26 "GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b" status: 200 len: 1568 microversion: 2.1 time: 0.187718 Sep 13 00:06:54.021807 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 492/978] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:06:53 2022] GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b => generated 1568 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:06:55.045899 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-587304f6-b917-495d-816f-e36fd7747d5e tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:06:55.046526 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-587304f6-b917-495d-816f-e36fd7747d5e tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] [instance: 5a30688a-8c79-425d-9679-0b15397e2c2b] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:06:55.053358 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-587304f6-b917-495d-816f-e36fd7747d5e tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:06:55.053843 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-587304f6-b917-495d-816f-e36fd7747d5e tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:06:55.054276 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-587304f6-b917-495d-816f-e36fd7747d5e tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:06:55.054970 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-587304f6-b917-495d-816f-e36fd7747d5e tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:06:55.055437 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-587304f6-b917-495d-816f-e36fd7747d5e tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:06:55.055887 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-587304f6-b917-495d-816f-e36fd7747d5e tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:06:55.195254 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-587304f6-b917-495d-816f-e36fd7747d5e tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb103e002840445db31703e141cf3a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b62652571943b58f9c8bd4c1ee9931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:06:55.203626 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-587304f6-b917-495d-816f-e36fd7747d5e tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] 10.222.0.26 "GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b" status: 200 len: 1509 microversion: 2.1 time: 0.161736 Sep 13 00:06:55.204193 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 487/979] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:06:55 2022] GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b => generated 1509 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:06:55.226262 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-ada7688f-ee3f-48ba-9df7-517ec930abeb tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 00:06:55.226935 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ada7688f-ee3f-48ba-9df7-517ec930abeb tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] [instance: 5a30688a-8c79-425d-9679-0b15397e2c2b] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:06:55.234128 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ada7688f-ee3f-48ba-9df7-517ec930abeb tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:06:55.234610 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ada7688f-ee3f-48ba-9df7-517ec930abeb tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:06:55.235046 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ada7688f-ee3f-48ba-9df7-517ec930abeb tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:06:55.235776 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ada7688f-ee3f-48ba-9df7-517ec930abeb tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:06:55.236231 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ada7688f-ee3f-48ba-9df7-517ec930abeb tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:06:55.236651 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-ada7688f-ee3f-48ba-9df7-517ec930abeb tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:06:55.281186 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-ada7688f-ee3f-48ba-9df7-517ec930abeb tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] [instance: 5a30688a-8c79-425d-9679-0b15397e2c2b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=126975) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 13 00:06:55.349642 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ada7688f-ee3f-48ba-9df7-517ec930abeb tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] [73291889-d35f-4fef-b1c9-0452171b6aef] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 13 00:06:56.358539 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO oslo.messaging._drivers.impl_rabbit [None req-ada7688f-ee3f-48ba-9df7-517ec930abeb tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] [73291889-d35f-4fef-b1c9-0452171b6aef] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 43576. Sep 13 00:06:56.361985 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-ada7688f-ee3f-48ba-9df7-517ec930abeb tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] 10.222.0.26 "POST /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b/action" status: 202 len: 0 microversion: 2.1 time: 1.139737 Sep 13 00:06:56.362612 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 493/980] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Sep 13 00:06:55 2022] POST /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b/action => generated 0 bytes in 1141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 00:06:56.370949 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b7dacc0d-e305-49a8-a765-b087285cc389 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:06:56.371703 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b7dacc0d-e305-49a8-a765-b087285cc389 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] [instance: 5a30688a-8c79-425d-9679-0b15397e2c2b] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:06:56.379336 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b7dacc0d-e305-49a8-a765-b087285cc389 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:06:56.379836 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b7dacc0d-e305-49a8-a765-b087285cc389 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:06:56.380234 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b7dacc0d-e305-49a8-a765-b087285cc389 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:06:56.380974 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b7dacc0d-e305-49a8-a765-b087285cc389 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:06:56.381430 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b7dacc0d-e305-49a8-a765-b087285cc389 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:06:56.381853 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b7dacc0d-e305-49a8-a765-b087285cc389 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:06:56.517881 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b7dacc0d-e305-49a8-a765-b087285cc389 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb103e002840445db31703e141cf3a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b62652571943b58f9c8bd4c1ee9931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:06:56.525992 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b7dacc0d-e305-49a8-a765-b087285cc389 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] 10.222.0.26 "GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b" status: 200 len: 1517 microversion: 2.1 time: 0.158958 Sep 13 00:06:56.526555 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 488/981] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:06:56 2022] GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:06:57.550073 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-a4140699-fd43-4c5c-83c3-e53c5ac23f4a tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:06:57.550654 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-a4140699-fd43-4c5c-83c3-e53c5ac23f4a tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] [instance: 5a30688a-8c79-425d-9679-0b15397e2c2b] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:06:57.558183 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a4140699-fd43-4c5c-83c3-e53c5ac23f4a tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:06:57.558649 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a4140699-fd43-4c5c-83c3-e53c5ac23f4a tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:06:57.559188 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a4140699-fd43-4c5c-83c3-e53c5ac23f4a tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:06:57.559980 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a4140699-fd43-4c5c-83c3-e53c5ac23f4a tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:06:57.560435 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a4140699-fd43-4c5c-83c3-e53c5ac23f4a tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:06:57.560852 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-a4140699-fd43-4c5c-83c3-e53c5ac23f4a tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:06:57.697336 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-a4140699-fd43-4c5c-83c3-e53c5ac23f4a tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb103e002840445db31703e141cf3a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b62652571943b58f9c8bd4c1ee9931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:06:57.705579 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-a4140699-fd43-4c5c-83c3-e53c5ac23f4a tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] 10.222.0.26 "GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b" status: 200 len: 1519 microversion: 2.1 time: 0.159998 Sep 13 00:06:57.706159 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 494/982] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:06:57 2022] GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:06:58.489619 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-1e5f7a56-06a2-4141-99bd-d6b35133462c req-6a8dce27-e661-4cf9-b14b-a95143aea4f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a30688a-8c79-425d-9679-0b15397e2c2b", "name": "network-vif-unplugged", "status": "completed", "tag": "e1cee19c-d5a9-45b9-bc59-8bd3e6eaf9cb"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 00:06:58.500799 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-1e5f7a56-06a2-4141-99bd-d6b35133462c req-6a8dce27-e661-4cf9-b14b-a95143aea4f6 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:06:58.501337 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-1e5f7a56-06a2-4141-99bd-d6b35133462c req-6a8dce27-e661-4cf9-b14b-a95143aea4f6 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:06:58.501886 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-1e5f7a56-06a2-4141-99bd-d6b35133462c req-6a8dce27-e661-4cf9-b14b-a95143aea4f6 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:06:58.514129 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-1e5f7a56-06a2-4141-99bd-d6b35133462c req-6a8dce27-e661-4cf9-b14b-a95143aea4f6 service nova] Creating event network-vif-unplugged:e1cee19c-d5a9-45b9-bc59-8bd3e6eaf9cb for instance 5a30688a-8c79-425d-9679-0b15397e2c2b on hv-cinder-82002 Sep 13 00:06:58.519282 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-1e5f7a56-06a2-4141-99bd-d6b35133462c req-6a8dce27-e661-4cf9-b14b-a95143aea4f6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033476 Sep 13 00:06:58.519905 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 489/983] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 13 00:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 00:06:58.730287 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-69e151a7-4add-461e-81e1-267783903b73 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:06:58.730979 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-69e151a7-4add-461e-81e1-267783903b73 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] [instance: 5a30688a-8c79-425d-9679-0b15397e2c2b] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:06:58.737519 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-69e151a7-4add-461e-81e1-267783903b73 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:06:58.738012 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-69e151a7-4add-461e-81e1-267783903b73 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:06:58.738473 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-69e151a7-4add-461e-81e1-267783903b73 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:06:58.739146 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-69e151a7-4add-461e-81e1-267783903b73 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:06:58.739618 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-69e151a7-4add-461e-81e1-267783903b73 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:06:58.740041 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-69e151a7-4add-461e-81e1-267783903b73 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:06:58.885270 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-69e151a7-4add-461e-81e1-267783903b73 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb103e002840445db31703e141cf3a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b62652571943b58f9c8bd4c1ee9931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:06:58.894315 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-69e151a7-4add-461e-81e1-267783903b73 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] 10.222.0.26 "GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b" status: 200 len: 1575 microversion: 2.1 time: 0.168105 Sep 13 00:06:58.894878 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 495/984] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:06:58 2022] GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:06:59.930958 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-8162a545-509b-4426-803b-c55b7ea189fa tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:06:59.931737 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-8162a545-509b-4426-803b-c55b7ea189fa tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] [instance: 5a30688a-8c79-425d-9679-0b15397e2c2b] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:06:59.939300 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8162a545-509b-4426-803b-c55b7ea189fa tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:06:59.939806 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8162a545-509b-4426-803b-c55b7ea189fa tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:06:59.940240 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8162a545-509b-4426-803b-c55b7ea189fa tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:06:59.940934 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8162a545-509b-4426-803b-c55b7ea189fa tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:06:59.941386 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8162a545-509b-4426-803b-c55b7ea189fa tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:06:59.941810 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-8162a545-509b-4426-803b-c55b7ea189fa tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:07:00.087851 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-8162a545-509b-4426-803b-c55b7ea189fa tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb103e002840445db31703e141cf3a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b62652571943b58f9c8bd4c1ee9931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:07:00.096084 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-8162a545-509b-4426-803b-c55b7ea189fa tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] 10.222.0.26 "GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b" status: 200 len: 1575 microversion: 2.1 time: 0.171961 Sep 13 00:07:00.096648 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 490/985] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:06:59 2022] GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b => generated 1575 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:07:01.120932 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-aa740854-8202-4408-9fed-50f0f28b57d2 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:07:01.121639 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-aa740854-8202-4408-9fed-50f0f28b57d2 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] [instance: 5a30688a-8c79-425d-9679-0b15397e2c2b] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:07:01.129124 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aa740854-8202-4408-9fed-50f0f28b57d2 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:07:01.129680 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aa740854-8202-4408-9fed-50f0f28b57d2 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:07:01.130214 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aa740854-8202-4408-9fed-50f0f28b57d2 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:07:01.131016 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aa740854-8202-4408-9fed-50f0f28b57d2 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:07:01.131613 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aa740854-8202-4408-9fed-50f0f28b57d2 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:07:01.132112 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-aa740854-8202-4408-9fed-50f0f28b57d2 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:07:01.280241 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-aa740854-8202-4408-9fed-50f0f28b57d2 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb103e002840445db31703e141cf3a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b62652571943b58f9c8bd4c1ee9931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:07:01.292493 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-aa740854-8202-4408-9fed-50f0f28b57d2 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] 10.222.0.26 "GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b" status: 200 len: 1575 microversion: 2.1 time: 0.175992 Sep 13 00:07:01.293416 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 496/986] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:07:01 2022] GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b => generated 1575 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:07:02.324435 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-2514cd17-0cde-4e62-97fa-051550f160ea tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:07:02.324980 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-2514cd17-0cde-4e62-97fa-051550f160ea tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] [instance: 5a30688a-8c79-425d-9679-0b15397e2c2b] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:07:02.331836 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2514cd17-0cde-4e62-97fa-051550f160ea tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:07:02.332306 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2514cd17-0cde-4e62-97fa-051550f160ea tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:07:02.332760 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2514cd17-0cde-4e62-97fa-051550f160ea tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:07:02.333463 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2514cd17-0cde-4e62-97fa-051550f160ea tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:07:02.333924 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2514cd17-0cde-4e62-97fa-051550f160ea tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:07:02.334348 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-2514cd17-0cde-4e62-97fa-051550f160ea tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:07:02.478647 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-2514cd17-0cde-4e62-97fa-051550f160ea tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb103e002840445db31703e141cf3a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b62652571943b58f9c8bd4c1ee9931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:07:02.487019 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-2514cd17-0cde-4e62-97fa-051550f160ea tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] 10.222.0.26 "GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b" status: 200 len: 1575 microversion: 2.1 time: 0.167742 Sep 13 00:07:02.487645 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 491/987] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:07:02 2022] GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:07:03.514880 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d1dc851a-08a9-4fb1-a112-e352157bce27 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:07:03.514880 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d1dc851a-08a9-4fb1-a112-e352157bce27 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] [instance: 5a30688a-8c79-425d-9679-0b15397e2c2b] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:07:03.523872 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d1dc851a-08a9-4fb1-a112-e352157bce27 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:07:03.524531 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d1dc851a-08a9-4fb1-a112-e352157bce27 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:07:03.524989 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d1dc851a-08a9-4fb1-a112-e352157bce27 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:07:03.525839 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d1dc851a-08a9-4fb1-a112-e352157bce27 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:07:03.526384 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d1dc851a-08a9-4fb1-a112-e352157bce27 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:07:03.526968 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d1dc851a-08a9-4fb1-a112-e352157bce27 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:07:03.676417 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d1dc851a-08a9-4fb1-a112-e352157bce27 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb103e002840445db31703e141cf3a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b62652571943b58f9c8bd4c1ee9931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:07:03.687170 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d1dc851a-08a9-4fb1-a112-e352157bce27 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] 10.222.0.26 "GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b" status: 200 len: 1575 microversion: 2.1 time: 0.179702 Sep 13 00:07:03.688020 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 497/988] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:07:03 2022] GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b => generated 1575 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:07:04.722895 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-e3153226-f76d-41e6-9b9e-6dcb41fd3b01 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:07:04.723907 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-e3153226-f76d-41e6-9b9e-6dcb41fd3b01 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] [instance: 5a30688a-8c79-425d-9679-0b15397e2c2b] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:07:04.732798 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3153226-f76d-41e6-9b9e-6dcb41fd3b01 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:07:04.733253 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3153226-f76d-41e6-9b9e-6dcb41fd3b01 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:07:04.733707 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3153226-f76d-41e6-9b9e-6dcb41fd3b01 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:07:04.734405 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3153226-f76d-41e6-9b9e-6dcb41fd3b01 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:07:04.734850 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3153226-f76d-41e6-9b9e-6dcb41fd3b01 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:07:04.735302 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-e3153226-f76d-41e6-9b9e-6dcb41fd3b01 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:07:04.890647 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-e3153226-f76d-41e6-9b9e-6dcb41fd3b01 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb103e002840445db31703e141cf3a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b62652571943b58f9c8bd4c1ee9931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:07:04.903789 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-e3153226-f76d-41e6-9b9e-6dcb41fd3b01 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] 10.222.0.26 "GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b" status: 200 len: 1575 microversion: 2.1 time: 0.186673 Sep 13 00:07:04.904731 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 492/989] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:07:04 2022] GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b => generated 1575 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:07:05.932615 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-0bfb357a-b872-4618-866d-10b36753c174 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:07:05.933311 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-0bfb357a-b872-4618-866d-10b36753c174 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] [instance: 5a30688a-8c79-425d-9679-0b15397e2c2b] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:07:05.940488 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0bfb357a-b872-4618-866d-10b36753c174 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:07:05.940965 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0bfb357a-b872-4618-866d-10b36753c174 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:07:05.941396 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0bfb357a-b872-4618-866d-10b36753c174 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:07:05.942118 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0bfb357a-b872-4618-866d-10b36753c174 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:07:05.942572 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0bfb357a-b872-4618-866d-10b36753c174 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:07:05.942991 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-0bfb357a-b872-4618-866d-10b36753c174 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:07:06.089846 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-0bfb357a-b872-4618-866d-10b36753c174 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb103e002840445db31703e141cf3a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b62652571943b58f9c8bd4c1ee9931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:07:06.098208 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-0bfb357a-b872-4618-866d-10b36753c174 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] 10.222.0.26 "GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b" status: 200 len: 1575 microversion: 2.1 time: 0.169585 Sep 13 00:07:06.098776 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 498/990] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:07:05 2022] GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:07:07.124708 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-b48d7ec7-26fb-4d8e-80d7-15e53b05b0c2 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:07:07.125406 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-b48d7ec7-26fb-4d8e-80d7-15e53b05b0c2 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] [instance: 5a30688a-8c79-425d-9679-0b15397e2c2b] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:07:07.132376 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b48d7ec7-26fb-4d8e-80d7-15e53b05b0c2 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:07:07.132863 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b48d7ec7-26fb-4d8e-80d7-15e53b05b0c2 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:07:07.133297 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b48d7ec7-26fb-4d8e-80d7-15e53b05b0c2 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:07:07.133991 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b48d7ec7-26fb-4d8e-80d7-15e53b05b0c2 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:07:07.134444 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b48d7ec7-26fb-4d8e-80d7-15e53b05b0c2 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:07:07.134864 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-b48d7ec7-26fb-4d8e-80d7-15e53b05b0c2 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:07:07.275152 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-b48d7ec7-26fb-4d8e-80d7-15e53b05b0c2 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb103e002840445db31703e141cf3a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b62652571943b58f9c8bd4c1ee9931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:07:07.284752 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-b48d7ec7-26fb-4d8e-80d7-15e53b05b0c2 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] 10.222.0.26 "GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b" status: 200 len: 1562 microversion: 2.1 time: 0.165532 Sep 13 00:07:07.285336 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 493/991] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:07:07 2022] GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b => generated 1562 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:07:08.597768 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-19ac58e9-c138-4c97-b9b3-86810722fadd req-b1d4e942-b0c1-4836-bc25-162c0f4929e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a30688a-8c79-425d-9679-0b15397e2c2b", "name": "network-vif-plugged", "status": "completed", "tag": "e1cee19c-d5a9-45b9-bc59-8bd3e6eaf9cb"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 00:07:08.608473 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-19ac58e9-c138-4c97-b9b3-86810722fadd req-b1d4e942-b0c1-4836-bc25-162c0f4929e5 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:07:08.608940 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-19ac58e9-c138-4c97-b9b3-86810722fadd req-b1d4e942-b0c1-4836-bc25-162c0f4929e5 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:07:08.609360 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-19ac58e9-c138-4c97-b9b3-86810722fadd req-b1d4e942-b0c1-4836-bc25-162c0f4929e5 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:07:08.620960 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-19ac58e9-c138-4c97-b9b3-86810722fadd req-b1d4e942-b0c1-4836-bc25-162c0f4929e5 service nova] Creating event network-vif-plugged:e1cee19c-d5a9-45b9-bc59-8bd3e6eaf9cb for instance 5a30688a-8c79-425d-9679-0b15397e2c2b on hv-cinder-82002 Sep 13 00:07:08.626116 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-19ac58e9-c138-4c97-b9b3-86810722fadd req-b1d4e942-b0c1-4836-bc25-162c0f4929e5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032120 Sep 13 00:07:08.626729 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 499/992] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 13 00:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 00:07:44.021955 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d01f8924-b234-4384-b844-4ad44aa68cb3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1600540531", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1764420964", "security_groups": [{"name": "tempest-secgroup-smoke-479345869"}], "block_device_mapping_v2": [{"uuid": "a4f17c90-a47d-4e88-aca4-7e70f6d4a3c3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "59fd1a5b-5d88-4e5e-aa91-1c1e68b4b584"}]}} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 00:07:44.032904 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=26 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:07:44.033531 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=74 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:07:44.034507 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 00:07:44.034668 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Tue Sep 13 00:07:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.26) !!! Sep 13 00:07:44.197323 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.network.neutron [None req-d01f8924-b234-4384-b844-4ad44aa68cb3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] validate_networks() for [('59fd1a5b-5d88-4e5e-aa91-1c1e68b4b584', None, None, None, None, None)] {{(pid=126976) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 00:07:44.583323 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-d01f8924-b234-4384-b844-4ad44aa68cb3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Flavor limits 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 00:07:44.583942 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-d01f8924-b234-4384-b844-4ad44aa68cb3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Image limits 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 00:07:44.584622 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-d01f8924-b234-4384-b844-4ad44aa68cb3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Flavor pref 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 00:07:44.585266 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-d01f8924-b234-4384-b844-4ad44aa68cb3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Image pref 0:0:0 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 00:07:44.585926 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.virt.hardware [None req-d01f8924-b234-4384-b844-4ad44aa68cb3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=126976) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 00:07:44.597211 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d01f8924-b234-4384-b844-4ad44aa68cb3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:07:44.597704 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d01f8924-b234-4384-b844-4ad44aa68cb3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:07:44.598134 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d01f8924-b234-4384-b844-4ad44aa68cb3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:07:44.598864 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d01f8924-b234-4384-b844-4ad44aa68cb3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:07:44.599349 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d01f8924-b234-4384-b844-4ad44aa68cb3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:07:44.599769 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d01f8924-b234-4384-b844-4ad44aa68cb3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:07:44.617930 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-d01f8924-b234-4384-b844-4ad44aa68cb3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Getting quotas for project ecac3196aefa4c32994f85a86849c8c8. Resources: {'instances', 'cores', 'ram'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 00:07:44.622426 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.quota [None req-d01f8924-b234-4384-b844-4ad44aa68cb3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Getting quotas for user f72b7cf8bf38477d8d6534eda6611982 and project ecac3196aefa4c32994f85a86849c8c8. Resources: {'instances', 'cores', 'ram'} {{(pid=126976) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 00:07:44.682984 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d01f8924-b234-4384-b844-4ad44aa68cb3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Going to run 1 instances... {{(pid=126976) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 00:07:44.685149 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d01f8924-b234-4384-b844-4ad44aa68cb3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: 48a37cc0-c0ef-4f9a-8e4f-84ec358e3787] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a4f17c90-a47d-4e88-aca4-7e70f6d4a3c3',volume_size=None,volume_type=None)] {{(pid=126976) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 00:07:44.824209 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d01f8924-b234-4384-b844-4ad44aa68cb3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.806234 Sep 13 00:07:44.824882 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 494/993] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Sep 13 00:07:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 00:07:44.834653 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:07:44.835549 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:07:44.840005 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-5a384c1d-f4f3-4ced-bdf5-ab73f02ec7bc tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:07:44.840837 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-5a384c1d-f4f3-4ced-bdf5-ab73f02ec7bc tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: 48a37cc0-c0ef-4f9a-8e4f-84ec358e3787] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:07:44.903491 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-5a384c1d-f4f3-4ced-bdf5-ab73f02ec7bc tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:07:44.911318 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-5a384c1d-f4f3-4ced-bdf5-ab73f02ec7bc tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/48a37cc0-c0ef-4f9a-8e4f-84ec358e3787" status: 200 len: 1095 microversion: 2.1 time: 0.078497 Sep 13 00:07:44.911905 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 500/994] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:07:44 2022] GET /compute/v2.1/servers/48a37cc0-c0ef-4f9a-8e4f-84ec358e3787 => generated 1095 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:07:45.934742 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-fc5515c4-ad24-4a88-8216-c0d9e732ee53 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:07:45.935383 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-fc5515c4-ad24-4a88-8216-c0d9e732ee53 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: 48a37cc0-c0ef-4f9a-8e4f-84ec358e3787] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:07:45.942771 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fc5515c4-ad24-4a88-8216-c0d9e732ee53 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:07:45.943352 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fc5515c4-ad24-4a88-8216-c0d9e732ee53 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:07:45.943828 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fc5515c4-ad24-4a88-8216-c0d9e732ee53 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:07:45.944563 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fc5515c4-ad24-4a88-8216-c0d9e732ee53 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:07:45.945025 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fc5515c4-ad24-4a88-8216-c0d9e732ee53 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:07:45.945448 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-fc5515c4-ad24-4a88-8216-c0d9e732ee53 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:07:46.031938 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-fc5515c4-ad24-4a88-8216-c0d9e732ee53 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:07:46.042025 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-fc5515c4-ad24-4a88-8216-c0d9e732ee53 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/48a37cc0-c0ef-4f9a-8e4f-84ec358e3787" status: 200 len: 1201 microversion: 2.1 time: 0.111866 Sep 13 00:07:46.042807 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 495/995] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:07:45 2022] GET /compute/v2.1/servers/48a37cc0-c0ef-4f9a-8e4f-84ec358e3787 => generated 1201 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:07:47.066313 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-8845e3c8-5e89-49db-8ab1-2cc0816a0682 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:07:47.066866 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-8845e3c8-5e89-49db-8ab1-2cc0816a0682 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: 48a37cc0-c0ef-4f9a-8e4f-84ec358e3787] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:07:47.075552 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8845e3c8-5e89-49db-8ab1-2cc0816a0682 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:07:47.076055 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8845e3c8-5e89-49db-8ab1-2cc0816a0682 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:07:47.076495 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8845e3c8-5e89-49db-8ab1-2cc0816a0682 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:07:47.077212 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8845e3c8-5e89-49db-8ab1-2cc0816a0682 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:07:47.077677 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8845e3c8-5e89-49db-8ab1-2cc0816a0682 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:07:47.078076 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-8845e3c8-5e89-49db-8ab1-2cc0816a0682 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:07:47.305814 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-8845e3c8-5e89-49db-8ab1-2cc0816a0682 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:07:47.314459 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-8845e3c8-5e89-49db-8ab1-2cc0816a0682 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/48a37cc0-c0ef-4f9a-8e4f-84ec358e3787" status: 200 len: 1266 microversion: 2.1 time: 0.252170 Sep 13 00:07:47.315048 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 501/996] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:07:47 2022] GET /compute/v2.1/servers/48a37cc0-c0ef-4f9a-8e4f-84ec358e3787 => generated 1266 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:07:47.516122 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-647f1472-fc53-4c92-b5a3-2918a73a581d req-73e12552-5ff3-4bb1-bb08-5c00db0181c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48a37cc0-c0ef-4f9a-8e4f-84ec358e3787", "tag": "54a27897-04fb-4fd7-aa9d-3ad92fe504c4"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 00:07:47.530940 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-647f1472-fc53-4c92-b5a3-2918a73a581d req-73e12552-5ff3-4bb1-bb08-5c00db0181c0 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:07:47.531457 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-647f1472-fc53-4c92-b5a3-2918a73a581d req-73e12552-5ff3-4bb1-bb08-5c00db0181c0 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:07:47.531871 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-647f1472-fc53-4c92-b5a3-2918a73a581d req-73e12552-5ff3-4bb1-bb08-5c00db0181c0 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:07:47.543169 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-647f1472-fc53-4c92-b5a3-2918a73a581d req-73e12552-5ff3-4bb1-bb08-5c00db0181c0 service nova] Creating event network-changed:54a27897-04fb-4fd7-aa9d-3ad92fe504c4 for instance 48a37cc0-c0ef-4f9a-8e4f-84ec358e3787 on hv-cinder-82002 Sep 13 00:07:47.548271 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-647f1472-fc53-4c92-b5a3-2918a73a581d req-73e12552-5ff3-4bb1-bb08-5c00db0181c0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036254 Sep 13 00:07:47.548967 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 496/997] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 13 00:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 00:07:48.336697 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-c6a385af-c1bd-48a3-96c3-4cecf25de743 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:07:48.337474 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-c6a385af-c1bd-48a3-96c3-4cecf25de743 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: 48a37cc0-c0ef-4f9a-8e4f-84ec358e3787] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:07:48.344136 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c6a385af-c1bd-48a3-96c3-4cecf25de743 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:07:48.344622 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c6a385af-c1bd-48a3-96c3-4cecf25de743 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:07:48.345048 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c6a385af-c1bd-48a3-96c3-4cecf25de743 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:07:48.345738 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c6a385af-c1bd-48a3-96c3-4cecf25de743 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:07:48.346260 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c6a385af-c1bd-48a3-96c3-4cecf25de743 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:07:48.346670 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-c6a385af-c1bd-48a3-96c3-4cecf25de743 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:07:48.574316 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-c6a385af-c1bd-48a3-96c3-4cecf25de743 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:07:48.583031 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-c6a385af-c1bd-48a3-96c3-4cecf25de743 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/48a37cc0-c0ef-4f9a-8e4f-84ec358e3787" status: 200 len: 1266 microversion: 2.1 time: 0.250191 Sep 13 00:07:48.583685 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 502/998] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:07:48 2022] GET /compute/v2.1/servers/48a37cc0-c0ef-4f9a-8e4f-84ec358e3787 => generated 1266 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:07:49.607259 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-29388224-0070-4cc9-9f77-d943cf34f040 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:07:49.607966 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-29388224-0070-4cc9-9f77-d943cf34f040 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: 48a37cc0-c0ef-4f9a-8e4f-84ec358e3787] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:07:49.614624 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-29388224-0070-4cc9-9f77-d943cf34f040 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:07:49.615103 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-29388224-0070-4cc9-9f77-d943cf34f040 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:07:49.615563 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-29388224-0070-4cc9-9f77-d943cf34f040 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:07:49.616260 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-29388224-0070-4cc9-9f77-d943cf34f040 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:07:49.616699 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-29388224-0070-4cc9-9f77-d943cf34f040 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:07:49.617113 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-29388224-0070-4cc9-9f77-d943cf34f040 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:07:49.758786 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-29388224-0070-4cc9-9f77-d943cf34f040 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:07:49.770554 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-29388224-0070-4cc9-9f77-d943cf34f040 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/48a37cc0-c0ef-4f9a-8e4f-84ec358e3787" status: 200 len: 1266 microversion: 2.1 time: 0.167832 Sep 13 00:07:49.771366 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 497/999] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:07:49 2022] GET /compute/v2.1/servers/48a37cc0-c0ef-4f9a-8e4f-84ec358e3787 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:07:50.794893 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-fc90879e-2ea5-4cd0-bd63-d197373152b8 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:07:50.795540 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-fc90879e-2ea5-4cd0-bd63-d197373152b8 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: 48a37cc0-c0ef-4f9a-8e4f-84ec358e3787] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:07:50.802725 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fc90879e-2ea5-4cd0-bd63-d197373152b8 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:07:50.803305 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fc90879e-2ea5-4cd0-bd63-d197373152b8 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:07:50.803678 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fc90879e-2ea5-4cd0-bd63-d197373152b8 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:07:50.804380 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fc90879e-2ea5-4cd0-bd63-d197373152b8 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:07:50.804836 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fc90879e-2ea5-4cd0-bd63-d197373152b8 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:07:50.805261 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-fc90879e-2ea5-4cd0-bd63-d197373152b8 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:07:50.958751 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-fc90879e-2ea5-4cd0-bd63-d197373152b8 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:07:50.968446 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-fc90879e-2ea5-4cd0-bd63-d197373152b8 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/48a37cc0-c0ef-4f9a-8e4f-84ec358e3787" status: 200 len: 1266 microversion: 2.1 time: 0.177354 Sep 13 00:07:50.969312 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 503/1000] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:07:50 2022] GET /compute/v2.1/servers/48a37cc0-c0ef-4f9a-8e4f-84ec358e3787 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:07:51.994533 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-14b261ae-dc6e-48cd-9b72-a163144657af tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:07:51.995138 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-14b261ae-dc6e-48cd-9b72-a163144657af tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: 48a37cc0-c0ef-4f9a-8e4f-84ec358e3787] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:07:52.002125 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-14b261ae-dc6e-48cd-9b72-a163144657af tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:07:52.002614 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-14b261ae-dc6e-48cd-9b72-a163144657af tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:07:52.003056 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-14b261ae-dc6e-48cd-9b72-a163144657af tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:07:52.003788 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-14b261ae-dc6e-48cd-9b72-a163144657af tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:07:52.004244 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-14b261ae-dc6e-48cd-9b72-a163144657af tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:07:52.004670 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-14b261ae-dc6e-48cd-9b72-a163144657af tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:07:52.144906 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-14b261ae-dc6e-48cd-9b72-a163144657af tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:07:52.153043 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-14b261ae-dc6e-48cd-9b72-a163144657af tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/48a37cc0-c0ef-4f9a-8e4f-84ec358e3787" status: 200 len: 1266 microversion: 2.1 time: 0.162626 Sep 13 00:07:52.153618 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 498/1001] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:07:51 2022] GET /compute/v2.1/servers/48a37cc0-c0ef-4f9a-8e4f-84ec358e3787 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:07:53.178359 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7c2b478e-c8ec-4206-a9eb-6981bdff56df tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:07:53.179068 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7c2b478e-c8ec-4206-a9eb-6981bdff56df tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: 48a37cc0-c0ef-4f9a-8e4f-84ec358e3787] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:07:53.187085 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7c2b478e-c8ec-4206-a9eb-6981bdff56df tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:07:53.187763 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7c2b478e-c8ec-4206-a9eb-6981bdff56df tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:07:53.188313 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7c2b478e-c8ec-4206-a9eb-6981bdff56df tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:07:53.189192 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7c2b478e-c8ec-4206-a9eb-6981bdff56df tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:07:53.189819 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7c2b478e-c8ec-4206-a9eb-6981bdff56df tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:07:53.190298 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7c2b478e-c8ec-4206-a9eb-6981bdff56df tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:07:53.339236 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7c2b478e-c8ec-4206-a9eb-6981bdff56df tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:07:53.347737 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7c2b478e-c8ec-4206-a9eb-6981bdff56df tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/48a37cc0-c0ef-4f9a-8e4f-84ec358e3787" status: 200 len: 1266 microversion: 2.1 time: 0.174655 Sep 13 00:07:53.348309 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 504/1002] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:07:53 2022] GET /compute/v2.1/servers/48a37cc0-c0ef-4f9a-8e4f-84ec358e3787 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:07:54.372917 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3161c000-9e40-4ffb-a21c-3f011d22fef4 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:07:54.373498 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3161c000-9e40-4ffb-a21c-3f011d22fef4 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: 48a37cc0-c0ef-4f9a-8e4f-84ec358e3787] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:07:54.380595 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3161c000-9e40-4ffb-a21c-3f011d22fef4 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:07:54.381089 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3161c000-9e40-4ffb-a21c-3f011d22fef4 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:07:54.381525 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3161c000-9e40-4ffb-a21c-3f011d22fef4 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:07:54.382233 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3161c000-9e40-4ffb-a21c-3f011d22fef4 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:07:54.382681 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3161c000-9e40-4ffb-a21c-3f011d22fef4 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:07:54.383117 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3161c000-9e40-4ffb-a21c-3f011d22fef4 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:07:54.528757 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-3161c000-9e40-4ffb-a21c-3f011d22fef4 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:07:54.539844 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3161c000-9e40-4ffb-a21c-3f011d22fef4 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/48a37cc0-c0ef-4f9a-8e4f-84ec358e3787" status: 200 len: 1266 microversion: 2.1 time: 0.171669 Sep 13 00:07:54.540643 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 499/1003] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:07:54 2022] GET /compute/v2.1/servers/48a37cc0-c0ef-4f9a-8e4f-84ec358e3787 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:07:55.565192 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-7bb95c42-2128-4e0e-84f3-39c4630472ed tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:07:55.565807 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-7bb95c42-2128-4e0e-84f3-39c4630472ed tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: 48a37cc0-c0ef-4f9a-8e4f-84ec358e3787] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:07:55.568495 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell0:SELECT=2 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:07:55.575610 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7bb95c42-2128-4e0e-84f3-39c4630472ed tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:07:55.576270 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7bb95c42-2128-4e0e-84f3-39c4630472ed tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:07:55.576809 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7bb95c42-2128-4e0e-84f3-39c4630472ed tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:07:55.577791 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7bb95c42-2128-4e0e-84f3-39c4630472ed tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:07:55.578425 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7bb95c42-2128-4e0e-84f3-39c4630472ed tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:07:55.579010 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-7bb95c42-2128-4e0e-84f3-39c4630472ed tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:07:55.722740 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-7bb95c42-2128-4e0e-84f3-39c4630472ed tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:07:55.734242 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-7bb95c42-2128-4e0e-84f3-39c4630472ed tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/48a37cc0-c0ef-4f9a-8e4f-84ec358e3787" status: 200 len: 1266 microversion: 2.1 time: 0.173408 Sep 13 00:07:55.735019 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 505/1004] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:07:55 2022] GET /compute/v2.1/servers/48a37cc0-c0ef-4f9a-8e4f-84ec358e3787 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:07:56.761569 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-1ae4d0ad-232b-4b67-aa4a-203c39225fd8 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:07:56.762613 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-1ae4d0ad-232b-4b67-aa4a-203c39225fd8 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: 48a37cc0-c0ef-4f9a-8e4f-84ec358e3787] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:07:56.765628 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell0:SELECT=2 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:07:56.766404 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell0:SELECT=6 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:07:56.771874 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1ae4d0ad-232b-4b67-aa4a-203c39225fd8 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:07:56.772430 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1ae4d0ad-232b-4b67-aa4a-203c39225fd8 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:07:56.772860 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1ae4d0ad-232b-4b67-aa4a-203c39225fd8 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:07:56.773585 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1ae4d0ad-232b-4b67-aa4a-203c39225fd8 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:07:56.774071 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1ae4d0ad-232b-4b67-aa4a-203c39225fd8 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:07:56.774561 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-1ae4d0ad-232b-4b67-aa4a-203c39225fd8 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:07:56.910112 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-1ae4d0ad-232b-4b67-aa4a-203c39225fd8 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:07:56.918266 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-1ae4d0ad-232b-4b67-aa4a-203c39225fd8 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/48a37cc0-c0ef-4f9a-8e4f-84ec358e3787" status: 200 len: 1266 microversion: 2.1 time: 0.161176 Sep 13 00:07:56.918852 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 500/1005] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:07:56 2022] GET /compute/v2.1/servers/48a37cc0-c0ef-4f9a-8e4f-84ec358e3787 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:07:57.941930 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-28086532-19e9-4fab-a816-f6922bbdd5c3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:07:57.942566 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-28086532-19e9-4fab-a816-f6922bbdd5c3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: 48a37cc0-c0ef-4f9a-8e4f-84ec358e3787] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:07:57.949641 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-28086532-19e9-4fab-a816-f6922bbdd5c3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:07:57.950132 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-28086532-19e9-4fab-a816-f6922bbdd5c3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:07:57.950571 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-28086532-19e9-4fab-a816-f6922bbdd5c3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:07:57.951252 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-28086532-19e9-4fab-a816-f6922bbdd5c3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:07:57.951761 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-28086532-19e9-4fab-a816-f6922bbdd5c3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:07:57.952180 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-28086532-19e9-4fab-a816-f6922bbdd5c3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:07:58.095917 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-28086532-19e9-4fab-a816-f6922bbdd5c3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:07:58.104962 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-28086532-19e9-4fab-a816-f6922bbdd5c3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/48a37cc0-c0ef-4f9a-8e4f-84ec358e3787" status: 200 len: 1266 microversion: 2.1 time: 0.166990 Sep 13 00:07:58.105580 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 506/1006] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:07:57 2022] GET /compute/v2.1/servers/48a37cc0-c0ef-4f9a-8e4f-84ec358e3787 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:07:58.829021 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-ff31f5dc-de1d-48f7-962f-9d0c58aa6f06 req-e74288a0-88d5-4dea-923e-6f2d3cb33704 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48a37cc0-c0ef-4f9a-8e4f-84ec358e3787", "name": "network-vif-plugged", "status": "completed", "tag": "54a27897-04fb-4fd7-aa9d-3ad92fe504c4"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 00:07:58.840381 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-ff31f5dc-de1d-48f7-962f-9d0c58aa6f06 req-e74288a0-88d5-4dea-923e-6f2d3cb33704 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:07:58.840889 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-ff31f5dc-de1d-48f7-962f-9d0c58aa6f06 req-e74288a0-88d5-4dea-923e-6f2d3cb33704 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:07:58.841346 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-ff31f5dc-de1d-48f7-962f-9d0c58aa6f06 req-e74288a0-88d5-4dea-923e-6f2d3cb33704 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:07:58.853458 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-ff31f5dc-de1d-48f7-962f-9d0c58aa6f06 req-e74288a0-88d5-4dea-923e-6f2d3cb33704 service nova] Creating event network-vif-plugged:54a27897-04fb-4fd7-aa9d-3ad92fe504c4 for instance 48a37cc0-c0ef-4f9a-8e4f-84ec358e3787 on hv-cinder-82002 Sep 13 00:07:58.858669 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-ff31f5dc-de1d-48f7-962f-9d0c58aa6f06 req-e74288a0-88d5-4dea-923e-6f2d3cb33704 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033741 Sep 13 00:07:58.859369 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 501/1007] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 13 00:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 00:07:59.128038 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-70b32f16-6674-45d1-a0ad-5e62ac9ebff4 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:07:59.128647 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-70b32f16-6674-45d1-a0ad-5e62ac9ebff4 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: 48a37cc0-c0ef-4f9a-8e4f-84ec358e3787] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:07:59.136113 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-70b32f16-6674-45d1-a0ad-5e62ac9ebff4 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:07:59.136603 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-70b32f16-6674-45d1-a0ad-5e62ac9ebff4 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:07:59.137010 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-70b32f16-6674-45d1-a0ad-5e62ac9ebff4 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:07:59.138065 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-70b32f16-6674-45d1-a0ad-5e62ac9ebff4 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:07:59.138545 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-70b32f16-6674-45d1-a0ad-5e62ac9ebff4 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:07:59.138958 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-70b32f16-6674-45d1-a0ad-5e62ac9ebff4 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:07:59.273889 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-70b32f16-6674-45d1-a0ad-5e62ac9ebff4 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:07:59.283676 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-70b32f16-6674-45d1-a0ad-5e62ac9ebff4 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/48a37cc0-c0ef-4f9a-8e4f-84ec358e3787" status: 200 len: 1266 microversion: 2.1 time: 0.159597 Sep 13 00:07:59.284241 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 507/1008] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:07:59 2022] GET /compute/v2.1/servers/48a37cc0-c0ef-4f9a-8e4f-84ec358e3787 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:08:00.307719 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-daab064a-c5cc-4ba8-ab35-52f9cb0191d3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:08:00.308450 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-daab064a-c5cc-4ba8-ab35-52f9cb0191d3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: 48a37cc0-c0ef-4f9a-8e4f-84ec358e3787] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:08:00.315195 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-daab064a-c5cc-4ba8-ab35-52f9cb0191d3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:08:00.315712 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-daab064a-c5cc-4ba8-ab35-52f9cb0191d3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:08:00.316149 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-daab064a-c5cc-4ba8-ab35-52f9cb0191d3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:08:00.316841 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-daab064a-c5cc-4ba8-ab35-52f9cb0191d3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:08:00.317299 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-daab064a-c5cc-4ba8-ab35-52f9cb0191d3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:08:00.317727 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-daab064a-c5cc-4ba8-ab35-52f9cb0191d3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:08:00.456594 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-daab064a-c5cc-4ba8-ab35-52f9cb0191d3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:08:00.464975 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-daab064a-c5cc-4ba8-ab35-52f9cb0191d3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/48a37cc0-c0ef-4f9a-8e4f-84ec358e3787" status: 200 len: 1266 microversion: 2.1 time: 0.162090 Sep 13 00:08:00.465543 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 502/1009] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:08:00 2022] GET /compute/v2.1/servers/48a37cc0-c0ef-4f9a-8e4f-84ec358e3787 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:08:01.491734 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9f025676-1ed8-4a4b-89fc-d512b8f6b07e tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:08:01.492443 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9f025676-1ed8-4a4b-89fc-d512b8f6b07e tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: 48a37cc0-c0ef-4f9a-8e4f-84ec358e3787] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:08:01.500831 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9f025676-1ed8-4a4b-89fc-d512b8f6b07e tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:08:01.501325 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9f025676-1ed8-4a4b-89fc-d512b8f6b07e tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:08:01.501746 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9f025676-1ed8-4a4b-89fc-d512b8f6b07e tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:08:01.502437 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9f025676-1ed8-4a4b-89fc-d512b8f6b07e tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:08:01.502884 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9f025676-1ed8-4a4b-89fc-d512b8f6b07e tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:08:01.503333 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9f025676-1ed8-4a4b-89fc-d512b8f6b07e tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:08:01.707657 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9f025676-1ed8-4a4b-89fc-d512b8f6b07e tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:08:01.716204 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9f025676-1ed8-4a4b-89fc-d512b8f6b07e tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/48a37cc0-c0ef-4f9a-8e4f-84ec358e3787" status: 200 len: 1453 microversion: 2.1 time: 0.230504 Sep 13 00:08:01.716908 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 508/1010] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:08:01 2022] GET /compute/v2.1/servers/48a37cc0-c0ef-4f9a-8e4f-84ec358e3787 => generated 1453 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:08:01.738151 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f94bbf6d-621d-41bf-8ba1-5cb180fbbea0 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:08:01.738714 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f94bbf6d-621d-41bf-8ba1-5cb180fbbea0 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: 48a37cc0-c0ef-4f9a-8e4f-84ec358e3787] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:08:01.745979 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f94bbf6d-621d-41bf-8ba1-5cb180fbbea0 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:08:01.746384 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f94bbf6d-621d-41bf-8ba1-5cb180fbbea0 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:08:01.746815 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f94bbf6d-621d-41bf-8ba1-5cb180fbbea0 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:08:01.747648 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f94bbf6d-621d-41bf-8ba1-5cb180fbbea0 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:08:01.748122 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f94bbf6d-621d-41bf-8ba1-5cb180fbbea0 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:08:01.748537 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f94bbf6d-621d-41bf-8ba1-5cb180fbbea0 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:08:01.951210 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-f94bbf6d-621d-41bf-8ba1-5cb180fbbea0 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:08:01.959171 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f94bbf6d-621d-41bf-8ba1-5cb180fbbea0 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/48a37cc0-c0ef-4f9a-8e4f-84ec358e3787" status: 200 len: 1453 microversion: 2.1 time: 0.224941 Sep 13 00:08:01.959771 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 503/1011] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:08:01 2022] GET /compute/v2.1/servers/48a37cc0-c0ef-4f9a-8e4f-84ec358e3787 => generated 1453 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:08:03.677191 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-59adafc0-4839-4bf3-8f3c-73f39c625511 req-34ddc786-3e6f-4a5e-946e-1fbe560ddf78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48a37cc0-c0ef-4f9a-8e4f-84ec358e3787", "tag": "54a27897-04fb-4fd7-aa9d-3ad92fe504c4"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 00:08:03.687053 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-59adafc0-4839-4bf3-8f3c-73f39c625511 req-34ddc786-3e6f-4a5e-946e-1fbe560ddf78 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:08:03.687560 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-59adafc0-4839-4bf3-8f3c-73f39c625511 req-34ddc786-3e6f-4a5e-946e-1fbe560ddf78 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:08:03.687984 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-59adafc0-4839-4bf3-8f3c-73f39c625511 req-34ddc786-3e6f-4a5e-946e-1fbe560ddf78 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:08:03.699390 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-59adafc0-4839-4bf3-8f3c-73f39c625511 req-34ddc786-3e6f-4a5e-946e-1fbe560ddf78 service nova] Creating event network-changed:54a27897-04fb-4fd7-aa9d-3ad92fe504c4 for instance 48a37cc0-c0ef-4f9a-8e4f-84ec358e3787 on hv-cinder-82002 Sep 13 00:08:03.705204 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-59adafc0-4839-4bf3-8f3c-73f39c625511 req-34ddc786-3e6f-4a5e-946e-1fbe560ddf78 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085477 Sep 13 00:08:03.705967 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 509/1012] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 13 00:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 00:08:26.698320 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0cadf9f1-d5b6-42cc-9c24-1e4b92c3b6d1 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:08:26.699023 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0cadf9f1-d5b6-42cc-9c24-1e4b92c3b6d1 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] [instance: 5a30688a-8c79-425d-9679-0b15397e2c2b] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:08:26.701458 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:08:26.701720 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-1a2cc1b1-f05c-4feb-a38d-01f97531714b req-7effa38d-0dd0-4790-bb99-8f1a983752bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a30688a-8c79-425d-9679-0b15397e2c2b", "tag": "e1cee19c-d5a9-45b9-bc59-8bd3e6eaf9cb"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 00:08:26.702689 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=48 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:08:26.708627 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0cadf9f1-d5b6-42cc-9c24-1e4b92c3b6d1 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:08:26.708969 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=22 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:08:26.709512 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=50 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:08:26.709978 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0cadf9f1-d5b6-42cc-9c24-1e4b92c3b6d1 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:08:26.710658 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0cadf9f1-d5b6-42cc-9c24-1e4b92c3b6d1 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:08:26.711573 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0cadf9f1-d5b6-42cc-9c24-1e4b92c3b6d1 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:08:26.712036 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0cadf9f1-d5b6-42cc-9c24-1e4b92c3b6d1 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:08:26.712609 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0cadf9f1-d5b6-42cc-9c24-1e4b92c3b6d1 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:08:26.714341 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-1a2cc1b1-f05c-4feb-a38d-01f97531714b req-7effa38d-0dd0-4790-bb99-8f1a983752bb service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:08:26.714886 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-1a2cc1b1-f05c-4feb-a38d-01f97531714b req-7effa38d-0dd0-4790-bb99-8f1a983752bb service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:08:26.715331 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-1a2cc1b1-f05c-4feb-a38d-01f97531714b req-7effa38d-0dd0-4790-bb99-8f1a983752bb service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:08:26.727829 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-1a2cc1b1-f05c-4feb-a38d-01f97531714b req-7effa38d-0dd0-4790-bb99-8f1a983752bb service nova] Creating event network-changed:e1cee19c-d5a9-45b9-bc59-8bd3e6eaf9cb for instance 5a30688a-8c79-425d-9679-0b15397e2c2b on hv-cinder-82002 Sep 13 00:08:26.736931 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-1a2cc1b1-f05c-4feb-a38d-01f97531714b req-7effa38d-0dd0-4790-bb99-8f1a983752bb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039311 Sep 13 00:08:26.737556 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 510/1013] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 13 00:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 00:08:26.741060 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0cadf9f1-d5b6-42cc-9c24-1e4b92c3b6d1 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] [instance: 5a30688a-8c79-425d-9679-0b15397e2c2b] Going to try to terminate instance {{(pid=126976) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 00:08:26.829544 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0cadf9f1-d5b6-42cc-9c24-1e4b92c3b6d1 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] 10.222.0.26 "DELETE /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b" status: 204 len: 0 microversion: 2.1 time: 0.134979 Sep 13 00:08:26.830455 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 504/1014] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Sep 13 00:08:26 2022] DELETE /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 00:08:26.839289 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-d023cc39-4fd0-4663-9cee-89fabaf956b0 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:08:26.840420 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-d023cc39-4fd0-4663-9cee-89fabaf956b0 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] [instance: 5a30688a-8c79-425d-9679-0b15397e2c2b] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:08:26.846803 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d023cc39-4fd0-4663-9cee-89fabaf956b0 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:08:26.847434 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d023cc39-4fd0-4663-9cee-89fabaf956b0 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:08:26.847985 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d023cc39-4fd0-4663-9cee-89fabaf956b0 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:08:26.848804 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d023cc39-4fd0-4663-9cee-89fabaf956b0 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:08:26.849329 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d023cc39-4fd0-4663-9cee-89fabaf956b0 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:08:26.849825 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-d023cc39-4fd0-4663-9cee-89fabaf956b0 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:08:27.014950 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-d023cc39-4fd0-4663-9cee-89fabaf956b0 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb103e002840445db31703e141cf3a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b62652571943b58f9c8bd4c1ee9931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:08:27.023102 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-d023cc39-4fd0-4663-9cee-89fabaf956b0 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] 10.222.0.26 "GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b" status: 200 len: 1568 microversion: 2.1 time: 0.188261 Sep 13 00:08:27.023717 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 511/1015] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:08:26 2022] GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b => generated 1568 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 00:08:28.048655 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-257d8091-aa42-4db3-b6b2-425a6051c878 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:08:28.049254 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-257d8091-aa42-4db3-b6b2-425a6051c878 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] [instance: 5a30688a-8c79-425d-9679-0b15397e2c2b] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:08:28.056678 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-257d8091-aa42-4db3-b6b2-425a6051c878 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:08:28.057148 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-257d8091-aa42-4db3-b6b2-425a6051c878 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:08:28.057603 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-257d8091-aa42-4db3-b6b2-425a6051c878 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:08:28.058469 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-257d8091-aa42-4db3-b6b2-425a6051c878 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:08:28.058947 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-257d8091-aa42-4db3-b6b2-425a6051c878 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:08:28.059407 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-257d8091-aa42-4db3-b6b2-425a6051c878 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:08:28.244450 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-257d8091-aa42-4db3-b6b2-425a6051c878 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb103e002840445db31703e141cf3a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b62652571943b58f9c8bd4c1ee9931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:08:28.252697 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-257d8091-aa42-4db3-b6b2-425a6051c878 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] 10.222.0.26 "GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b" status: 200 len: 1568 microversion: 2.1 time: 0.209500 Sep 13 00:08:28.253269 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 505/1016] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:08:28 2022] GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b => generated 1568 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:08:29.096268 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [req-aec394be-e41d-485b-8af5-421b81fb57b0 req-fe82e1c8-1740-4f30-8f9c-6c09e6561e03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a30688a-8c79-425d-9679-0b15397e2c2b", "name": "network-vif-deleted", "tag": "e1cee19c-d5a9-45b9-bc59-8bd3e6eaf9cb"}]} {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 00:08:29.107802 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-aec394be-e41d-485b-8af5-421b81fb57b0 req-fe82e1c8-1740-4f30-8f9c-6c09e6561e03 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:08:29.108280 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-aec394be-e41d-485b-8af5-421b81fb57b0 req-fe82e1c8-1740-4f30-8f9c-6c09e6561e03 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:08:29.108716 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [req-aec394be-e41d-485b-8af5-421b81fb57b0 req-fe82e1c8-1740-4f30-8f9c-6c09e6561e03 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:08:29.122544 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.compute.server_external_events [req-aec394be-e41d-485b-8af5-421b81fb57b0 req-fe82e1c8-1740-4f30-8f9c-6c09e6561e03 service nova] Creating event network-vif-deleted:e1cee19c-d5a9-45b9-bc59-8bd3e6eaf9cb for instance 5a30688a-8c79-425d-9679-0b15397e2c2b on hv-cinder-82002 Sep 13 00:08:29.129096 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [req-aec394be-e41d-485b-8af5-421b81fb57b0 req-fe82e1c8-1740-4f30-8f9c-6c09e6561e03 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036356 Sep 13 00:08:29.129724 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 512/1017] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 13 00:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 00:08:29.279601 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-570dee79-ef02-4188-9a74-591957a6d65a tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:08:29.280172 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-570dee79-ef02-4188-9a74-591957a6d65a tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] [instance: 5a30688a-8c79-425d-9679-0b15397e2c2b] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:08:29.289995 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-570dee79-ef02-4188-9a74-591957a6d65a tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:08:29.290660 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-570dee79-ef02-4188-9a74-591957a6d65a tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:08:29.291291 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-570dee79-ef02-4188-9a74-591957a6d65a tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:08:29.292317 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-570dee79-ef02-4188-9a74-591957a6d65a tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:08:29.292830 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-570dee79-ef02-4188-9a74-591957a6d65a tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:08:29.293387 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-570dee79-ef02-4188-9a74-591957a6d65a tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:08:29.360856 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-570dee79-ef02-4188-9a74-591957a6d65a tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb103e002840445db31703e141cf3a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07b62652571943b58f9c8bd4c1ee9931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:08:29.372228 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-570dee79-ef02-4188-9a74-591957a6d65a tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] 10.222.0.26 "GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b" status: 200 len: 1220 microversion: 2.1 time: 0.097381 Sep 13 00:08:29.372850 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 506/1018] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:08:29 2022] GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b => generated 1220 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:08:30.397909 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f981dc13-2b55-4d65-8909-4adbe1440cff tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:08:30.398653 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-f981dc13-2b55-4d65-8909-4adbe1440cff tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] [instance: 5a30688a-8c79-425d-9679-0b15397e2c2b] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:08:30.407130 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f981dc13-2b55-4d65-8909-4adbe1440cff tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:08:30.407130 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f981dc13-2b55-4d65-8909-4adbe1440cff tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:08:30.407130 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f981dc13-2b55-4d65-8909-4adbe1440cff tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:08:30.407130 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f981dc13-2b55-4d65-8909-4adbe1440cff tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:08:30.407645 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f981dc13-2b55-4d65-8909-4adbe1440cff tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:08:30.407745 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-f981dc13-2b55-4d65-8909-4adbe1440cff tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:08:30.422129 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-f981dc13-2b55-4d65-8909-4adbe1440cff tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] HTTP exception thrown: Instance 5a30688a-8c79-425d-9679-0b15397e2c2b could not be found. Sep 13 00:08:30.423834 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f981dc13-2b55-4d65-8909-4adbe1440cff tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Request method failure captured: Sep 13 00:08:30.423834 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: request: GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b HTTP/1.1 Sep 13 00:08:30.423834 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept: application/json Sep 13 00:08:30.423834 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Sep 13 00:08:30.423834 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Connection: close Sep 13 00:08:30.423834 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Length: 0 Sep 13 00:08:30.423834 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Type: application/json Sep 13 00:08:30.423834 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Host: 10.222.0.26 Sep 13 00:08:30.423834 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Sep 13 00:08:30.423834 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Sep 13 00:08:30.423834 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjH8jyEkrTyz5_hZJopNVCWlwHEKqJx1PxdQ09J41zPqXqN9JxKwPPZWxdxhQlZntMFg6gKClF8aBqW3FN7d_VU1evyaOHULKknSskzeNgPt-p825lFbuFS5UVH9wR4l00sMPNIXifxi__iTsTLHA5lzi1hVS0vo7Vy8FaucNzO_Etii4 Sep 13 00:08:30.423834 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Sep 13 00:08:30.423834 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Sep 13 00:08:30.423834 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Sep 13 00:08:30.423834 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Sep 13 00:08:30.423834 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Sep 13 00:08:30.423834 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Sep 13 00:08:30.423834 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Id: 07b62652571943b58f9c8bd4c1ee9931 Sep 13 00:08:30.423834 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-TestShelveInstance-1736543648 Sep 13 00:08:30.423834 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Role: member,reader Sep 13 00:08:30.423834 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Roles: member,reader Sep 13 00:08:30.425887 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/07b62652571943b58f9c8bd4c1ee9931"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/07b62652571943b58f9c8bd4c1ee9931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_07b62652571943b58f9c8bd4c1ee9931"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/07b62652571943b58f9c8bd4c1ee9931"}]}] Sep 13 00:08:30.425887 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-TestShelveInstance-1736543648 Sep 13 00:08:30.425887 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Id: 07b62652571943b58f9c8bd4c1ee9931 Sep 13 00:08:30.425887 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-TestShelveInstance-1736543648 Sep 13 00:08:30.425887 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User: tempest-TestShelveInstance-1736543648-project Sep 13 00:08:30.425887 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Sep 13 00:08:30.425887 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Sep 13 00:08:30.425887 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Id: fb103e002840445db31703e141cf3a66 Sep 13 00:08:30.425887 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-TestShelveInstance-1736543648-project Sep 13 00:08:30.425887 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: method: > Sep 13 00:08:30.425887 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: exception: Instance 5a30688a-8c79-425d-9679-0b15397e2c2b could not be found. Sep 13 00:08:30.425887 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: action_args: {'id': '5a30688a-8c79-425d-9679-0b15397e2c2b'} Sep 13 00:08:30.426997 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 00:08:30.426997 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:08:30.426997 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 00:08:30.426997 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 00:08:30.426997 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 00:08:30.426997 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 00:08:30.426997 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 00:08:30.426997 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 00:08:30.426997 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 00:08:30.426997 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 00:08:30.426997 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a30688a-8c79-425d-9679-0b15397e2c2b could not be found. Sep 13 00:08:30.426997 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:08:30.426997 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 00:08:30.426997 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:08:30.426997 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:08:30.426997 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 00:08:30.426997 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 00:08:30.426997 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 00:08:30.426997 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 00:08:30.426997 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 00:08:30.428728 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 00:08:30.428728 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 00:08:30.428728 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 00:08:30.428728 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 00:08:30.428728 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 00:08:30.428728 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 00:08:30.428728 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 00:08:30.428728 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a30688a-8c79-425d-9679-0b15397e2c2b could not be found. Sep 13 00:08:30.428728 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:08:30.428728 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 00:08:30.428728 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:08:30.428728 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:08:30.428728 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 00:08:30.428728 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 00:08:30.428728 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 00:08:30.428728 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 00:08:30.428728 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a30688a-8c79-425d-9679-0b15397e2c2b could not be found. Sep 13 00:08:30.428728 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:08:30.430755 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-f981dc13-2b55-4d65-8909-4adbe1440cff tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Returning 404 to user: Instance 5a30688a-8c79-425d-9679-0b15397e2c2b could not be found. {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 00:08:30.430755 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-f981dc13-2b55-4d65-8909-4adbe1440cff tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] 10.222.0.26 "GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b" status: 404 len: 111 microversion: 2.1 time: 0.032322 Sep 13 00:08:30.430755 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 513/1019] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:08:30 2022] GET /compute/v2.1/servers/5a30688a-8c79-425d-9679-0b15397e2c2b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 00:08:30.600071 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-c404cec5-a946-4a80-8d4b-7c9e5854b019 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] Calling method '.version_select at 0x7fed013083a0>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:08:30.625269 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-c404cec5-a946-4a80-8d4b-7c9e5854b019 tempest-TestShelveInstance-1736543648 tempest-TestShelveInstance-1736543648-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1882983442" status: 202 len: 0 microversion: 2.1 time: 0.028796 Sep 13 00:08:30.626374 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 507/1020] 10.222.0.26 () {58 vars in 1254 bytes} [Tue Sep 13 00:08:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1882983442 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 00:09:32.013584 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_api:SELECT=8 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:09:32.014814 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG dbcounter [-] [126975] Writing DB stats nova_cell1:SELECT=12 {{(pid=126975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:09:32.016453 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 13 00:09:32.017564 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 00:09:32.017955 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Tue Sep 13 00:09:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/48a37cc0-c0ef-4f9a-8e4f-84ec358e3787 (ip 10.222.0.26) !!! Sep 13 00:09:32.022252 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:09:32.022734 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-766ae38a-40cd-438f-a407-5cd80b5b4a4d tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:09:32.023034 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG dbcounter [-] [126976] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=126976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 00:09:32.023497 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-766ae38a-40cd-438f-a407-5cd80b5b4a4d tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: 48a37cc0-c0ef-4f9a-8e4f-84ec358e3787] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:09:32.038981 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-766ae38a-40cd-438f-a407-5cd80b5b4a4d tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:09:32.039529 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-766ae38a-40cd-438f-a407-5cd80b5b4a4d tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:09:32.040134 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-766ae38a-40cd-438f-a407-5cd80b5b4a4d tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:09:32.041266 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-766ae38a-40cd-438f-a407-5cd80b5b4a4d tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:09:32.041884 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-766ae38a-40cd-438f-a407-5cd80b5b4a4d tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:09:32.042513 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-766ae38a-40cd-438f-a407-5cd80b5b4a4d tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:09:32.075907 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-766ae38a-40cd-438f-a407-5cd80b5b4a4d tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: 48a37cc0-c0ef-4f9a-8e4f-84ec358e3787] Going to try to terminate instance {{(pid=126975) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 00:09:32.163851 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-766ae38a-40cd-438f-a407-5cd80b5b4a4d tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "DELETE /compute/v2.1/servers/48a37cc0-c0ef-4f9a-8e4f-84ec358e3787" status: 204 len: 0 microversion: 2.1 time: 0.151238 Sep 13 00:09:32.166430 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 514/1021] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Sep 13 00:09:32 2022] DELETE /compute/v2.1/servers/48a37cc0-c0ef-4f9a-8e4f-84ec358e3787 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 00:09:32.180257 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-6f266b8b-8cc8-4b43-bdf1-8d8a947386b3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:09:32.180971 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-6f266b8b-8cc8-4b43-bdf1-8d8a947386b3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: 48a37cc0-c0ef-4f9a-8e4f-84ec358e3787] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:09:32.187415 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-10729824-5629-4e98-97b6-4e05af47b2b2 req-a619eba2-f9f0-4ebd-8eae-6b5d911c5d5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48a37cc0-c0ef-4f9a-8e4f-84ec358e3787", "tag": "54a27897-04fb-4fd7-aa9d-3ad92fe504c4"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 00:09:32.187764 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6f266b8b-8cc8-4b43-bdf1-8d8a947386b3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:09:32.188146 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6f266b8b-8cc8-4b43-bdf1-8d8a947386b3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:09:32.188638 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6f266b8b-8cc8-4b43-bdf1-8d8a947386b3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:09:32.189300 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6f266b8b-8cc8-4b43-bdf1-8d8a947386b3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:09:32.189759 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6f266b8b-8cc8-4b43-bdf1-8d8a947386b3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:09:32.190180 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-6f266b8b-8cc8-4b43-bdf1-8d8a947386b3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:09:32.198621 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-10729824-5629-4e98-97b6-4e05af47b2b2 req-a619eba2-f9f0-4ebd-8eae-6b5d911c5d5a service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:09:32.199182 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-10729824-5629-4e98-97b6-4e05af47b2b2 req-a619eba2-f9f0-4ebd-8eae-6b5d911c5d5a service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:09:32.199920 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-10729824-5629-4e98-97b6-4e05af47b2b2 req-a619eba2-f9f0-4ebd-8eae-6b5d911c5d5a service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:09:32.212007 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-10729824-5629-4e98-97b6-4e05af47b2b2 req-a619eba2-f9f0-4ebd-8eae-6b5d911c5d5a service nova] Creating event network-changed:54a27897-04fb-4fd7-aa9d-3ad92fe504c4 for instance 48a37cc0-c0ef-4f9a-8e4f-84ec358e3787 on hv-cinder-82002 Sep 13 00:09:32.217451 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-10729824-5629-4e98-97b6-4e05af47b2b2 req-a619eba2-f9f0-4ebd-8eae-6b5d911c5d5a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.203540 Sep 13 00:09:32.218536 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 508/1022] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 13 00:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 00:09:32.326823 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-6f266b8b-8cc8-4b43-bdf1-8d8a947386b3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:09:32.334773 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-6f266b8b-8cc8-4b43-bdf1-8d8a947386b3 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/48a37cc0-c0ef-4f9a-8e4f-84ec358e3787" status: 200 len: 1577 microversion: 2.1 time: 0.161737 Sep 13 00:09:32.335360 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 515/1023] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:09:32 2022] GET /compute/v2.1/servers/48a37cc0-c0ef-4f9a-8e4f-84ec358e3787 => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:09:33.362404 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-d63c1560-d2a3-4a1e-a662-e4226cfda634 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:09:33.363330 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-d63c1560-d2a3-4a1e-a662-e4226cfda634 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: 48a37cc0-c0ef-4f9a-8e4f-84ec358e3787] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:09:33.372731 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d63c1560-d2a3-4a1e-a662-e4226cfda634 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:09:33.373238 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d63c1560-d2a3-4a1e-a662-e4226cfda634 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:09:33.373678 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d63c1560-d2a3-4a1e-a662-e4226cfda634 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:09:33.374412 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d63c1560-d2a3-4a1e-a662-e4226cfda634 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:09:33.374871 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d63c1560-d2a3-4a1e-a662-e4226cfda634 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:09:33.375315 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-d63c1560-d2a3-4a1e-a662-e4226cfda634 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:09:33.548051 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-d63c1560-d2a3-4a1e-a662-e4226cfda634 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:09:33.559255 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-d63c1560-d2a3-4a1e-a662-e4226cfda634 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/48a37cc0-c0ef-4f9a-8e4f-84ec358e3787" status: 200 len: 1577 microversion: 2.1 time: 0.202953 Sep 13 00:09:33.560161 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 509/1024] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:09:33 2022] GET /compute/v2.1/servers/48a37cc0-c0ef-4f9a-8e4f-84ec358e3787 => generated 1577 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:09:34.586788 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-9ffd9935-ee98-404a-a36e-ffd00352e47f tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:09:34.587472 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-9ffd9935-ee98-404a-a36e-ffd00352e47f tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: 48a37cc0-c0ef-4f9a-8e4f-84ec358e3787] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:09:34.594783 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9ffd9935-ee98-404a-a36e-ffd00352e47f tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:09:34.595280 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9ffd9935-ee98-404a-a36e-ffd00352e47f tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:09:34.595719 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9ffd9935-ee98-404a-a36e-ffd00352e47f tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:09:34.596429 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9ffd9935-ee98-404a-a36e-ffd00352e47f tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:09:34.596890 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9ffd9935-ee98-404a-a36e-ffd00352e47f tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:09:34.598078 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-9ffd9935-ee98-404a-a36e-ffd00352e47f tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:09:34.618930 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-d667363d-1607-4343-aa66-f4a8307134b2 req-fb089bf2-0d8b-45f4-a95e-3003378a4995 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48a37cc0-c0ef-4f9a-8e4f-84ec358e3787", "name": "network-vif-deleted", "tag": "54a27897-04fb-4fd7-aa9d-3ad92fe504c4"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 00:09:34.632547 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-d667363d-1607-4343-aa66-f4a8307134b2 req-fb089bf2-0d8b-45f4-a95e-3003378a4995 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:09:34.633122 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-d667363d-1607-4343-aa66-f4a8307134b2 req-fb089bf2-0d8b-45f4-a95e-3003378a4995 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:09:34.633622 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-d667363d-1607-4343-aa66-f4a8307134b2 req-fb089bf2-0d8b-45f4-a95e-3003378a4995 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:09:34.645812 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-d667363d-1607-4343-aa66-f4a8307134b2 req-fb089bf2-0d8b-45f4-a95e-3003378a4995 service nova] Creating event network-vif-deleted:54a27897-04fb-4fd7-aa9d-3ad92fe504c4 for instance 48a37cc0-c0ef-4f9a-8e4f-84ec358e3787 on hv-cinder-82002 Sep 13 00:09:34.651279 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-d667363d-1607-4343-aa66-f4a8307134b2 req-fb089bf2-0d8b-45f4-a95e-3003378a4995 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036025 Sep 13 00:09:34.652163 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 510/1025] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 13 00:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 00:09:34.679822 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-9ffd9935-ee98-404a-a36e-ffd00352e47f tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:09:34.688707 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-9ffd9935-ee98-404a-a36e-ffd00352e47f tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/48a37cc0-c0ef-4f9a-8e4f-84ec358e3787" status: 200 len: 1392 microversion: 2.1 time: 0.105085 Sep 13 00:09:34.689361 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 516/1026] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:09:34 2022] GET /compute/v2.1/servers/48a37cc0-c0ef-4f9a-8e4f-84ec358e3787 => generated 1392 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:09:35.716293 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-89fc801f-3313-487f-994d-d5ab4ac9892b tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:09:35.717123 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-89fc801f-3313-487f-994d-d5ab4ac9892b tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: 48a37cc0-c0ef-4f9a-8e4f-84ec358e3787] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:09:35.725803 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-89fc801f-3313-487f-994d-d5ab4ac9892b tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:09:35.726445 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-89fc801f-3313-487f-994d-d5ab4ac9892b tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:09:35.727015 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-89fc801f-3313-487f-994d-d5ab4ac9892b tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:09:35.727977 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-89fc801f-3313-487f-994d-d5ab4ac9892b tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:09:35.728574 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-89fc801f-3313-487f-994d-d5ab4ac9892b tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:09:35.729145 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-89fc801f-3313-487f-994d-d5ab4ac9892b tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:09:35.743326 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-89fc801f-3313-487f-994d-d5ab4ac9892b tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] HTTP exception thrown: Instance 48a37cc0-c0ef-4f9a-8e4f-84ec358e3787 could not be found. Sep 13 00:09:35.745000 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-89fc801f-3313-487f-994d-d5ab4ac9892b tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Request method failure captured: Sep 13 00:09:35.745000 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: request: GET /compute/v2.1/servers/48a37cc0-c0ef-4f9a-8e4f-84ec358e3787 HTTP/1.1 Sep 13 00:09:35.745000 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Accept: application/json Sep 13 00:09:35.745000 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Sep 13 00:09:35.745000 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Connection: close Sep 13 00:09:35.745000 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Content-Length: 0 Sep 13 00:09:35.745000 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Content-Type: application/json Sep 13 00:09:35.745000 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Host: 10.222.0.26 Sep 13 00:09:35.745000 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Sep 13 00:09:35.745000 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Sep 13 00:09:35.745000 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjH8ieIf0SS7l927NoqdI6rNak3A3fj-EtELfnByFeDDlS_iJCl8Tx5W14auNs85ugE0SAUaG5GlsBIEpIt2r7LoLFF25y-Xut7lKss-jTEALd3Krxu7HCpSIaJf5NDsEWiNxUZJEPjvVubEx6gkAjine6C6XbJCnxMSnyECNt4Xjowo0 Sep 13 00:09:35.745000 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Sep 13 00:09:35.745000 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Sep 13 00:09:35.745000 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Sep 13 00:09:35.745000 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Sep 13 00:09:35.745000 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Sep 13 00:09:35.745000 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Sep 13 00:09:35.745000 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Id: ecac3196aefa4c32994f85a86849c8c8 Sep 13 00:09:35.745000 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-TestVolumeBootPattern-507873504 Sep 13 00:09:35.745000 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Role: member,reader Sep 13 00:09:35.745000 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Roles: member,reader Sep 13 00:09:35.746899 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ecac3196aefa4c32994f85a86849c8c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ecac3196aefa4c32994f85a86849c8c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ecac3196aefa4c32994f85a86849c8c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ecac3196aefa4c32994f85a86849c8c8"}]}] Sep 13 00:09:35.746899 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-TestVolumeBootPattern-507873504 Sep 13 00:09:35.746899 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant-Id: ecac3196aefa4c32994f85a86849c8c8 Sep 13 00:09:35.746899 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-TestVolumeBootPattern-507873504 Sep 13 00:09:35.746899 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User: tempest-TestVolumeBootPattern-507873504-project Sep 13 00:09:35.746899 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Sep 13 00:09:35.746899 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Sep 13 00:09:35.746899 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Id: f72b7cf8bf38477d8d6534eda6611982 Sep 13 00:09:35.746899 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-TestVolumeBootPattern-507873504-project Sep 13 00:09:35.746899 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: method: > Sep 13 00:09:35.746899 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: exception: Instance 48a37cc0-c0ef-4f9a-8e4f-84ec358e3787 could not be found. Sep 13 00:09:35.746899 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: action_args: {'id': '48a37cc0-c0ef-4f9a-8e4f-84ec358e3787'} Sep 13 00:09:35.747990 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 00:09:35.747990 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:09:35.747990 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 00:09:35.747990 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 00:09:35.747990 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 00:09:35.747990 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 00:09:35.747990 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 00:09:35.747990 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 00:09:35.747990 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 00:09:35.747990 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 00:09:35.747990 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48a37cc0-c0ef-4f9a-8e4f-84ec358e3787 could not be found. Sep 13 00:09:35.747990 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:09:35.747990 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 00:09:35.747990 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:09:35.747990 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:09:35.747990 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 00:09:35.747990 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 00:09:35.747990 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 00:09:35.747990 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 00:09:35.747990 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 00:09:35.749707 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 00:09:35.749707 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 00:09:35.749707 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 00:09:35.749707 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 00:09:35.749707 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 00:09:35.749707 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 00:09:35.749707 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 00:09:35.749707 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48a37cc0-c0ef-4f9a-8e4f-84ec358e3787 could not be found. Sep 13 00:09:35.749707 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:09:35.749707 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 00:09:35.749707 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:09:35.749707 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:09:35.749707 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 00:09:35.749707 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 00:09:35.749707 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 00:09:35.749707 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 00:09:35.749707 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48a37cc0-c0ef-4f9a-8e4f-84ec358e3787 could not be found. Sep 13 00:09:35.749707 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:09:35.751197 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-89fc801f-3313-487f-994d-d5ab4ac9892b tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Returning 404 to user: Instance 48a37cc0-c0ef-4f9a-8e4f-84ec358e3787 could not be found. {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 00:09:35.751197 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-89fc801f-3313-487f-994d-d5ab4ac9892b tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/48a37cc0-c0ef-4f9a-8e4f-84ec358e3787" status: 404 len: 111 microversion: 2.1 time: 0.036619 Sep 13 00:09:35.751197 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 511/1027] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:09:35 2022] GET /compute/v2.1/servers/48a37cc0-c0ef-4f9a-8e4f-84ec358e3787 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 00:09:39.192393 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-05c977e0-8c31-47f6-99d1-9e174390b198 req-87fbdb87-8c6d-478e-b543-6297ea5d3ce0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a84f1bfa-7436-44a1-99b2-afed7be788d7", "tag": "1a401adb-f709-4d9f-85c3-c51e6e947891"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 00:09:39.195953 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-238fd1fe-6ca0-4973-9b87-fc2d4c5b151c tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:09:39.196457 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-238fd1fe-6ca0-4973-9b87-fc2d4c5b151c tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: a84f1bfa-7436-44a1-99b2-afed7be788d7] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:09:39.210333 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-05c977e0-8c31-47f6-99d1-9e174390b198 req-87fbdb87-8c6d-478e-b543-6297ea5d3ce0 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:09:39.211180 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-05c977e0-8c31-47f6-99d1-9e174390b198 req-87fbdb87-8c6d-478e-b543-6297ea5d3ce0 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:09:39.211593 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-238fd1fe-6ca0-4973-9b87-fc2d4c5b151c tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:09:39.211957 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-05c977e0-8c31-47f6-99d1-9e174390b198 req-87fbdb87-8c6d-478e-b543-6297ea5d3ce0 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:09:39.212083 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-238fd1fe-6ca0-4973-9b87-fc2d4c5b151c tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:09:39.212523 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-238fd1fe-6ca0-4973-9b87-fc2d4c5b151c tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:09:39.213247 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-238fd1fe-6ca0-4973-9b87-fc2d4c5b151c tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:09:39.213711 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-238fd1fe-6ca0-4973-9b87-fc2d4c5b151c tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:09:39.214137 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-238fd1fe-6ca0-4973-9b87-fc2d4c5b151c tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:09:39.227953 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-05c977e0-8c31-47f6-99d1-9e174390b198 req-87fbdb87-8c6d-478e-b543-6297ea5d3ce0 service nova] Creating event network-changed:1a401adb-f709-4d9f-85c3-c51e6e947891 for instance a84f1bfa-7436-44a1-99b2-afed7be788d7 on hv-cinder-82002 Sep 13 00:09:39.233338 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-05c977e0-8c31-47f6-99d1-9e174390b198 req-87fbdb87-8c6d-478e-b543-6297ea5d3ce0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044555 Sep 13 00:09:39.235459 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 512/1028] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 13 00:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 00:09:39.242887 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-238fd1fe-6ca0-4973-9b87-fc2d4c5b151c tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: a84f1bfa-7436-44a1-99b2-afed7be788d7] Going to try to terminate instance {{(pid=126975) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 00:09:39.343172 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-238fd1fe-6ca0-4973-9b87-fc2d4c5b151c tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a84f1bfa-7436-44a1-99b2-afed7be788d7" status: 204 len: 0 microversion: 2.1 time: 0.156242 Sep 13 00:09:39.344992 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 517/1029] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Sep 13 00:09:39 2022] DELETE /compute/v2.1/servers/a84f1bfa-7436-44a1-99b2-afed7be788d7 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 00:09:39.357508 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-0c6d9579-126e-4166-bd41-3202156e6396 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:09:39.359485 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-0c6d9579-126e-4166-bd41-3202156e6396 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: a84f1bfa-7436-44a1-99b2-afed7be788d7] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:09:39.366360 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c6d9579-126e-4166-bd41-3202156e6396 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:09:39.366848 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c6d9579-126e-4166-bd41-3202156e6396 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:09:39.367296 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c6d9579-126e-4166-bd41-3202156e6396 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:09:39.368010 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c6d9579-126e-4166-bd41-3202156e6396 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:09:39.368459 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c6d9579-126e-4166-bd41-3202156e6396 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:09:39.368889 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-0c6d9579-126e-4166-bd41-3202156e6396 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:09:39.535451 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.policy [None req-0c6d9579-126e-4166-bd41-3202156e6396 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126976) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:09:39.543467 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-0c6d9579-126e-4166-bd41-3202156e6396 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/a84f1bfa-7436-44a1-99b2-afed7be788d7" status: 200 len: 1576 microversion: 2.1 time: 0.193584 Sep 13 00:09:39.544021 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 513/1030] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:09:39 2022] GET /compute/v2.1/servers/a84f1bfa-7436-44a1-99b2-afed7be788d7 => generated 1576 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:09:40.568001 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-737f0581-24f0-4684-a709-857ad263dc54 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:09:40.568702 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-737f0581-24f0-4684-a709-857ad263dc54 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: a84f1bfa-7436-44a1-99b2-afed7be788d7] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:09:40.576418 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-737f0581-24f0-4684-a709-857ad263dc54 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:09:40.576908 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-737f0581-24f0-4684-a709-857ad263dc54 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:09:40.577335 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-737f0581-24f0-4684-a709-857ad263dc54 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:09:40.578183 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-737f0581-24f0-4684-a709-857ad263dc54 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:09:40.578663 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-737f0581-24f0-4684-a709-857ad263dc54 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:09:40.579083 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-737f0581-24f0-4684-a709-857ad263dc54 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:09:40.748722 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-737f0581-24f0-4684-a709-857ad263dc54 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:09:40.756969 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-737f0581-24f0-4684-a709-857ad263dc54 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/a84f1bfa-7436-44a1-99b2-afed7be788d7" status: 200 len: 1576 microversion: 2.1 time: 0.193286 Sep 13 00:09:40.757795 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 518/1031] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:09:40 2022] GET /compute/v2.1/servers/a84f1bfa-7436-44a1-99b2-afed7be788d7 => generated 1576 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:09:41.579243 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [req-c058d69e-ff28-4624-ad6e-359dd0871fec req-af70739b-f6ee-400d-95b2-c460e4921175 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a84f1bfa-7436-44a1-99b2-afed7be788d7", "name": "network-vif-deleted", "tag": "1a401adb-f709-4d9f-85c3-c51e6e947891"}]} {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 00:09:41.588995 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-c058d69e-ff28-4624-ad6e-359dd0871fec req-af70739b-f6ee-400d-95b2-c460e4921175 service nova] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:09:41.589466 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-c058d69e-ff28-4624-ad6e-359dd0871fec req-af70739b-f6ee-400d-95b2-c460e4921175 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:09:41.589908 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [req-c058d69e-ff28-4624-ad6e-359dd0871fec req-af70739b-f6ee-400d-95b2-c460e4921175 service nova] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:09:41.602382 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.compute.server_external_events [req-c058d69e-ff28-4624-ad6e-359dd0871fec req-af70739b-f6ee-400d-95b2-c460e4921175 service nova] Creating event network-vif-deleted:1a401adb-f709-4d9f-85c3-c51e6e947891 for instance a84f1bfa-7436-44a1-99b2-afed7be788d7 on hv-cinder-82002 Sep 13 00:09:41.607422 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [req-c058d69e-ff28-4624-ad6e-359dd0871fec req-af70739b-f6ee-400d-95b2-c460e4921175 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031734 Sep 13 00:09:41.608028 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 514/1032] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Sep 13 00:09:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 00:09:41.782033 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-09f563b1-d70a-453e-8b0f-d65aeff892cd tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:09:41.782655 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-09f563b1-d70a-453e-8b0f-d65aeff892cd tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: a84f1bfa-7436-44a1-99b2-afed7be788d7] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:09:41.789661 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-09f563b1-d70a-453e-8b0f-d65aeff892cd tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:09:41.790084 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-09f563b1-d70a-453e-8b0f-d65aeff892cd tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:09:41.790579 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-09f563b1-d70a-453e-8b0f-d65aeff892cd tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:09:41.791209 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-09f563b1-d70a-453e-8b0f-d65aeff892cd tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:09:41.791725 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-09f563b1-d70a-453e-8b0f-d65aeff892cd tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:09:41.792130 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-09f563b1-d70a-453e-8b0f-d65aeff892cd tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:09:41.860397 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.policy [None req-09f563b1-d70a-453e-8b0f-d65aeff892cd tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f72b7cf8bf38477d8d6534eda6611982', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecac3196aefa4c32994f85a86849c8c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=126975) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 00:09:41.870152 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-09f563b1-d70a-453e-8b0f-d65aeff892cd tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/a84f1bfa-7436-44a1-99b2-afed7be788d7" status: 200 len: 1226 microversion: 2.1 time: 0.091759 Sep 13 00:09:41.874190 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 519/1033] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:09:41 2022] GET /compute/v2.1/servers/a84f1bfa-7436-44a1-99b2-afed7be788d7 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 00:09:42.898641 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3eafa97c-a84e-4db3-84f3-6e70d447dece tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:09:42.899405 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-3eafa97c-a84e-4db3-84f3-6e70d447dece tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: a84f1bfa-7436-44a1-99b2-afed7be788d7] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:09:42.907050 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3eafa97c-a84e-4db3-84f3-6e70d447dece tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:09:42.907578 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3eafa97c-a84e-4db3-84f3-6e70d447dece tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:09:42.908019 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3eafa97c-a84e-4db3-84f3-6e70d447dece tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:09:42.908721 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3eafa97c-a84e-4db3-84f3-6e70d447dece tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:09:42.909182 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3eafa97c-a84e-4db3-84f3-6e70d447dece tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:09:42.909606 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-3eafa97c-a84e-4db3-84f3-6e70d447dece tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:09:42.925291 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-3eafa97c-a84e-4db3-84f3-6e70d447dece tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] HTTP exception thrown: Instance a84f1bfa-7436-44a1-99b2-afed7be788d7 could not be found. Sep 13 00:09:42.926939 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3eafa97c-a84e-4db3-84f3-6e70d447dece tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Request method failure captured: Sep 13 00:09:42.926939 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: request: GET /compute/v2.1/servers/a84f1bfa-7436-44a1-99b2-afed7be788d7 HTTP/1.1 Sep 13 00:09:42.926939 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Accept: application/json Sep 13 00:09:42.926939 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Sep 13 00:09:42.926939 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Connection: close Sep 13 00:09:42.926939 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Content-Length: 0 Sep 13 00:09:42.926939 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Content-Type: application/json Sep 13 00:09:42.926939 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Host: 10.222.0.26 Sep 13 00:09:42.926939 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Sep 13 00:09:42.926939 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Sep 13 00:09:42.926939 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjH8ieIf0SS7l927NoqdI6rNak3A3fj-EtELfnByFeDDlS_iJCl8Tx5W14auNs85ugE0SAUaG5GlsBIEpIt2r7LoLFF25y-Xut7lKss-jTEALd3Krxu7HCpSIaJf5NDsEWiNxUZJEPjvVubEx6gkAjine6C6XbJCnxMSnyECNt4Xjowo0 Sep 13 00:09:42.926939 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Sep 13 00:09:42.926939 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Sep 13 00:09:42.926939 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Sep 13 00:09:42.926939 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Sep 13 00:09:42.926939 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Sep 13 00:09:42.926939 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Sep 13 00:09:42.926939 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Id: ecac3196aefa4c32994f85a86849c8c8 Sep 13 00:09:42.926939 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-TestVolumeBootPattern-507873504 Sep 13 00:09:42.926939 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Role: member,reader Sep 13 00:09:42.926939 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Roles: member,reader Sep 13 00:09:42.928718 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ecac3196aefa4c32994f85a86849c8c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ecac3196aefa4c32994f85a86849c8c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ecac3196aefa4c32994f85a86849c8c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ecac3196aefa4c32994f85a86849c8c8"}]}] Sep 13 00:09:42.928718 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-TestVolumeBootPattern-507873504 Sep 13 00:09:42.928718 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant-Id: ecac3196aefa4c32994f85a86849c8c8 Sep 13 00:09:42.928718 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-TestVolumeBootPattern-507873504 Sep 13 00:09:42.928718 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User: tempest-TestVolumeBootPattern-507873504-project Sep 13 00:09:42.928718 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Sep 13 00:09:42.928718 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Sep 13 00:09:42.928718 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Id: f72b7cf8bf38477d8d6534eda6611982 Sep 13 00:09:42.928718 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-TestVolumeBootPattern-507873504-project Sep 13 00:09:42.928718 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: method: > Sep 13 00:09:42.928718 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: exception: Instance a84f1bfa-7436-44a1-99b2-afed7be788d7 could not be found. Sep 13 00:09:42.928718 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: action_args: {'id': 'a84f1bfa-7436-44a1-99b2-afed7be788d7'} Sep 13 00:09:42.929618 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 00:09:42.929618 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:09:42.929618 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 00:09:42.929618 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 00:09:42.929618 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 00:09:42.929618 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 00:09:42.929618 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 00:09:42.929618 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 00:09:42.929618 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 00:09:42.929618 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 00:09:42.929618 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a84f1bfa-7436-44a1-99b2-afed7be788d7 could not be found. Sep 13 00:09:42.929618 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:09:42.929618 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 00:09:42.929618 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:09:42.929618 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:09:42.929618 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 00:09:42.929618 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 00:09:42.929618 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 00:09:42.929618 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 00:09:42.929618 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 00:09:42.931064 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 00:09:42.931064 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 00:09:42.931064 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 00:09:42.931064 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 00:09:42.931064 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 00:09:42.931064 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 00:09:42.931064 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 00:09:42.931064 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a84f1bfa-7436-44a1-99b2-afed7be788d7 could not be found. Sep 13 00:09:42.931064 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:09:42.931064 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 00:09:42.931064 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:09:42.931064 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:09:42.931064 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 00:09:42.931064 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 00:09:42.931064 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 00:09:42.931064 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 00:09:42.931064 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a84f1bfa-7436-44a1-99b2-afed7be788d7 could not be found. Sep 13 00:09:42.931064 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:09:42.932406 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-3eafa97c-a84e-4db3-84f3-6e70d447dece tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Returning 404 to user: Instance a84f1bfa-7436-44a1-99b2-afed7be788d7 could not be found. {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 00:09:42.932406 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-3eafa97c-a84e-4db3-84f3-6e70d447dece tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/a84f1bfa-7436-44a1-99b2-afed7be788d7" status: 404 len: 111 microversion: 2.1 time: 0.035564 Sep 13 00:09:42.932406 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 515/1034] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:09:42 2022] GET /compute/v2.1/servers/a84f1bfa-7436-44a1-99b2-afed7be788d7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 00:09:43.386623 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-35cabc6f-4575-4d6c-9ef9-43b6b514274b tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:09:43.387178 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.compute.api [None req-35cabc6f-4575-4d6c-9ef9-43b6b514274b tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: 3a76679f-7a4a-411e-afc4-747058b284a6] Fetching instance by UUID {{(pid=126975) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:09:43.394017 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-35cabc6f-4575-4d6c-9ef9-43b6b514274b tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:09:43.394503 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-35cabc6f-4575-4d6c-9ef9-43b6b514274b tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:09:43.394940 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-35cabc6f-4575-4d6c-9ef9-43b6b514274b tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:09:43.395667 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-35cabc6f-4575-4d6c-9ef9-43b6b514274b tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:09:43.396122 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-35cabc6f-4575-4d6c-9ef9-43b6b514274b tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:09:43.396544 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG oslo_concurrency.lockutils [None req-35cabc6f-4575-4d6c-9ef9-43b6b514274b tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:09:43.410459 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.wsgi [None req-35cabc6f-4575-4d6c-9ef9-43b6b514274b tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] HTTP exception thrown: Instance 3a76679f-7a4a-411e-afc4-747058b284a6 could not be found. Sep 13 00:09:43.412147 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-35cabc6f-4575-4d6c-9ef9-43b6b514274b tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Request method failure captured: Sep 13 00:09:43.412147 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: request: DELETE /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6 HTTP/1.1 Sep 13 00:09:43.412147 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept: application/json Sep 13 00:09:43.412147 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Accept-Encoding: identity Sep 13 00:09:43.412147 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Connection: close Sep 13 00:09:43.412147 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Length: 0 Sep 13 00:09:43.412147 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Content-Type: application/json Sep 13 00:09:43.412147 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Host: 10.222.0.26 Sep 13 00:09:43.412147 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: Openstack-System-Scope: None Sep 13 00:09:43.412147 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: User-Agent: python-urllib3/1.26.12 Sep 13 00:09:43.412147 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Auth-Token: gAAAAABjH8ieIf0SS7l927NoqdI6rNak3A3fj-EtELfnByFeDDlS_iJCl8Tx5W14auNs85ugE0SAUaG5GlsBIEpIt2r7LoLFF25y-Xut7lKss-jTEALd3Krxu7HCpSIaJf5NDsEWiNxUZJEPjvVubEx6gkAjine6C6XbJCnxMSnyECNt4Xjowo0 Sep 13 00:09:43.412147 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Id: None Sep 13 00:09:43.412147 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Domain-Name: None Sep 13 00:09:43.412147 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Identity-Status: Confirmed Sep 13 00:09:43.412147 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Is-Admin-Project: True Sep 13 00:09:43.412147 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Id: default Sep 13 00:09:43.412147 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Domain-Name: Default Sep 13 00:09:43.412147 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Id: ecac3196aefa4c32994f85a86849c8c8 Sep 13 00:09:43.412147 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Project-Name: tempest-TestVolumeBootPattern-507873504 Sep 13 00:09:43.412147 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Role: member,reader Sep 13 00:09:43.412147 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Roles: member,reader Sep 13 00:09:43.413840 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ecac3196aefa4c32994f85a86849c8c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ecac3196aefa4c32994f85a86849c8c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ecac3196aefa4c32994f85a86849c8c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ecac3196aefa4c32994f85a86849c8c8"}]}] Sep 13 00:09:43.413840 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant: tempest-TestVolumeBootPattern-507873504 Sep 13 00:09:43.413840 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Id: ecac3196aefa4c32994f85a86849c8c8 Sep 13 00:09:43.413840 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-Tenant-Name: tempest-TestVolumeBootPattern-507873504 Sep 13 00:09:43.413840 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User: tempest-TestVolumeBootPattern-507873504-project Sep 13 00:09:43.413840 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Id: default Sep 13 00:09:43.413840 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Domain-Name: Default Sep 13 00:09:43.413840 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Id: f72b7cf8bf38477d8d6534eda6611982 Sep 13 00:09:43.413840 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: X-User-Name: tempest-TestVolumeBootPattern-507873504-project Sep 13 00:09:43.413840 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: method: > Sep 13 00:09:43.413840 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: exception: Instance 3a76679f-7a4a-411e-afc4-747058b284a6 could not be found. Sep 13 00:09:43.413840 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: action_args: {'id': '3a76679f-7a4a-411e-afc4-747058b284a6'} Sep 13 00:09:43.414780 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 00:09:43.414780 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:09:43.414780 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 00:09:43.414780 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 00:09:43.414780 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 00:09:43.414780 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 00:09:43.414780 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 00:09:43.414780 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 00:09:43.414780 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 00:09:43.414780 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 00:09:43.414780 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a76679f-7a4a-411e-afc4-747058b284a6 could not be found. Sep 13 00:09:43.414780 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:09:43.414780 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 00:09:43.414780 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:09:43.414780 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:09:43.414780 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 00:09:43.414780 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 00:09:43.414780 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 00:09:43.414780 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 00:09:43.414780 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 00:09:43.416435 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 00:09:43.416435 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 00:09:43.416435 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 00:09:43.416435 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 00:09:43.416435 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 00:09:43.416435 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 00:09:43.416435 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 00:09:43.416435 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 00:09:43.416435 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 00:09:43.416435 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a76679f-7a4a-411e-afc4-747058b284a6 could not be found. Sep 13 00:09:43.416435 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:09:43.416435 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 00:09:43.416435 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:09:43.416435 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:09:43.416435 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 00:09:43.416435 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 00:09:43.416435 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 00:09:43.416435 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 00:09:43.416435 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a76679f-7a4a-411e-afc4-747058b284a6 could not be found. Sep 13 00:09:43.416435 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: ERROR nova.api.openstack.wsgi Sep 13 00:09:43.418300 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-35cabc6f-4575-4d6c-9ef9-43b6b514274b tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Returning 404 to user: Instance 3a76679f-7a4a-411e-afc4-747058b284a6 could not be found. {{(pid=126975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 00:09:43.418300 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-35cabc6f-4575-4d6c-9ef9-43b6b514274b tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6" status: 404 len: 111 microversion: 2.1 time: 0.031330 Sep 13 00:09:43.418300 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 520/1035] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Sep 13 00:09:43 2022] DELETE /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 00:09:43.423001 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f7340028-b424-4855-addf-742c774976d9 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '>' {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:09:43.423663 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.compute.api [None req-f7340028-b424-4855-addf-742c774976d9 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] [instance: 3a76679f-7a4a-411e-afc4-747058b284a6] Fetching instance by UUID {{(pid=126976) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 00:09:43.429778 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f7340028-b424-4855-addf-742c774976d9 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:09:43.430259 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f7340028-b424-4855-addf-742c774976d9 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:09:43.430690 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f7340028-b424-4855-addf-742c774976d9 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:09:43.431414 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f7340028-b424-4855-addf-742c774976d9 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Acquiring lock "f9381776-92ff-451b-9afd-34bdc816952e" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 00:09:43.431864 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f7340028-b424-4855-addf-742c774976d9 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 00:09:43.432280 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG oslo_concurrency.lockutils [None req-f7340028-b424-4855-addf-742c774976d9 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Lock "f9381776-92ff-451b-9afd-34bdc816952e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=126976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 00:09:43.446615 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.wsgi [None req-f7340028-b424-4855-addf-742c774976d9 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] HTTP exception thrown: Instance 3a76679f-7a4a-411e-afc4-747058b284a6 could not be found. Sep 13 00:09:43.448184 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f7340028-b424-4855-addf-742c774976d9 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Request method failure captured: Sep 13 00:09:43.448184 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: request: GET /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6 HTTP/1.1 Sep 13 00:09:43.448184 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Accept: application/json Sep 13 00:09:43.448184 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Accept-Encoding: identity Sep 13 00:09:43.448184 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Connection: close Sep 13 00:09:43.448184 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Content-Length: 0 Sep 13 00:09:43.448184 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Content-Type: application/json Sep 13 00:09:43.448184 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Host: 10.222.0.26 Sep 13 00:09:43.448184 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: Openstack-System-Scope: None Sep 13 00:09:43.448184 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: User-Agent: python-urllib3/1.26.12 Sep 13 00:09:43.448184 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Auth-Token: gAAAAABjH8ieIf0SS7l927NoqdI6rNak3A3fj-EtELfnByFeDDlS_iJCl8Tx5W14auNs85ugE0SAUaG5GlsBIEpIt2r7LoLFF25y-Xut7lKss-jTEALd3Krxu7HCpSIaJf5NDsEWiNxUZJEPjvVubEx6gkAjine6C6XbJCnxMSnyECNt4Xjowo0 Sep 13 00:09:43.448184 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Domain-Id: None Sep 13 00:09:43.448184 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Domain-Name: None Sep 13 00:09:43.448184 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Identity-Status: Confirmed Sep 13 00:09:43.448184 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Is-Admin-Project: True Sep 13 00:09:43.448184 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Domain-Id: default Sep 13 00:09:43.448184 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Domain-Name: Default Sep 13 00:09:43.448184 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Id: ecac3196aefa4c32994f85a86849c8c8 Sep 13 00:09:43.448184 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Project-Name: tempest-TestVolumeBootPattern-507873504 Sep 13 00:09:43.448184 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Role: member,reader Sep 13 00:09:43.448184 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Roles: member,reader Sep 13 00:09:43.449934 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ecac3196aefa4c32994f85a86849c8c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ecac3196aefa4c32994f85a86849c8c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ecac3196aefa4c32994f85a86849c8c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ecac3196aefa4c32994f85a86849c8c8"}]}] Sep 13 00:09:43.449934 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant: tempest-TestVolumeBootPattern-507873504 Sep 13 00:09:43.449934 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant-Id: ecac3196aefa4c32994f85a86849c8c8 Sep 13 00:09:43.449934 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-Tenant-Name: tempest-TestVolumeBootPattern-507873504 Sep 13 00:09:43.449934 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User: tempest-TestVolumeBootPattern-507873504-project Sep 13 00:09:43.449934 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Domain-Id: default Sep 13 00:09:43.449934 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Domain-Name: Default Sep 13 00:09:43.449934 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Id: f72b7cf8bf38477d8d6534eda6611982 Sep 13 00:09:43.449934 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: X-User-Name: tempest-TestVolumeBootPattern-507873504-project Sep 13 00:09:43.449934 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: method: > Sep 13 00:09:43.449934 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: exception: Instance 3a76679f-7a4a-411e-afc4-747058b284a6 could not be found. Sep 13 00:09:43.449934 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: action_args: {'id': '3a76679f-7a4a-411e-afc4-747058b284a6'} Sep 13 00:09:43.450881 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: {{(pid=126976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 00:09:43.450881 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:09:43.450881 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 00:09:43.450881 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 00:09:43.450881 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 00:09:43.450881 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 00:09:43.450881 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 00:09:43.450881 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 00:09:43.450881 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 00:09:43.450881 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 00:09:43.450881 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a76679f-7a4a-411e-afc4-747058b284a6 could not be found. Sep 13 00:09:43.450881 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:09:43.450881 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 00:09:43.450881 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:09:43.450881 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:09:43.450881 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 00:09:43.450881 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 00:09:43.450881 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 00:09:43.450881 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 00:09:43.450881 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 00:09:43.452490 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 00:09:43.452490 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 00:09:43.452490 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 00:09:43.452490 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 00:09:43.452490 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 00:09:43.452490 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 00:09:43.452490 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 00:09:43.452490 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a76679f-7a4a-411e-afc4-747058b284a6 could not be found. Sep 13 00:09:43.452490 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:09:43.452490 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 00:09:43.452490 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:09:43.452490 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 00:09:43.452490 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 00:09:43.452490 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 00:09:43.452490 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 00:09:43.452490 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 00:09:43.452490 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a76679f-7a4a-411e-afc4-747058b284a6 could not be found. Sep 13 00:09:43.452490 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: ERROR nova.api.openstack.wsgi Sep 13 00:09:43.453945 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: DEBUG nova.api.openstack.wsgi [None req-f7340028-b424-4855-addf-742c774976d9 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Returning 404 to user: Instance 3a76679f-7a4a-411e-afc4-747058b284a6 could not be found. {{(pid=126976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 00:09:43.453945 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: INFO nova.api.openstack.requestlog [None req-f7340028-b424-4855-addf-742c774976d9 tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "GET /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6" status: 404 len: 111 microversion: 2.1 time: 0.030746 Sep 13 00:09:43.453945 dv-cinder-820027-26-iscsi devstack@n-api.service[126976]: [pid: 126976|app: 0|req: 516/1036] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Sep 13 00:09:43 2022] GET /compute/v2.1/servers/3a76679f-7a4a-411e-afc4-747058b284a6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 00:09:44.956728 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: DEBUG nova.api.openstack.wsgi [None req-63894582-b787-4ee1-a874-34765ea425aa tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] Calling method '.version_select at 0x7fed0151dd30>' {{(pid=126975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 00:09:44.982724 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: INFO nova.api.openstack.requestlog [None req-63894582-b787-4ee1-a874-34765ea425aa tempest-TestVolumeBootPattern-507873504 tempest-TestVolumeBootPattern-507873504-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1764420964" status: 202 len: 0 microversion: 2.1 time: 0.029762 Sep 13 00:09:44.983378 dv-cinder-820027-26-iscsi devstack@n-api.service[126975]: [pid: 126975|app: 0|req: 521/1037] 10.222.0.26 () {58 vars in 1263 bytes} [Tue Sep 13 00:09:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1764420964 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)